2023-10-01 16:01:22,561 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-10-01 16:01:22,767 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d 2023-10-01 16:01:22,768 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-10-01 16:01:22,768 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-10-01 16:01:22,810 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-01 16:01:23,047 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-01 16:01:23,047 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/cluster_dc626531-59bc-a717-57a6-1c05e4c967d9, deleteOnExit=true 2023-10-01 16:01:23,047 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-01 16:01:23,048 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/test.cache.data in system properties and HBase conf 2023-10-01 16:01:23,048 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/hadoop.tmp.dir in system properties and HBase conf 2023-10-01 16:01:23,049 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/hadoop.log.dir in system properties and HBase conf 2023-10-01 16:01:23,049 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-01 16:01:23,049 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-01 16:01:23,049 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-01 16:01:23,369 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-01 16:01:23,374 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-01 16:01:23,374 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-01 16:01:23,375 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-01 16:01:23,375 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-01 16:01:23,375 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-01 16:01:23,375 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-01 16:01:23,376 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-01 16:01:23,376 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-01 16:01:23,377 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-01 16:01:23,377 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/nfs.dump.dir in system properties and HBase conf 2023-10-01 16:01:23,378 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/java.io.tmpdir in system properties and HBase conf 2023-10-01 16:01:23,378 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-01 16:01:23,378 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-01 16:01:23,379 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-01 16:01:23,879 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-01 16:01:23,884 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-01 16:01:24,194 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-01 16:01:24,388 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-01 16:01:24,403 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 16:01:24,458 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 16:01:24,493 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/java.io.tmpdir/Jetty_localhost_35049_hdfs____.8urcxv/webapp 2023-10-01 16:01:24,626 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35049 2023-10-01 16:01:24,666 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-01 16:01:24,666 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-01 16:01:25,141 WARN [Listener at localhost/44103] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-01 16:01:25,213 WARN [Listener at localhost/44103] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-01 16:01:25,234 WARN [Listener at localhost/44103] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 16:01:25,241 INFO [Listener at localhost/44103] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 16:01:25,247 INFO [Listener at localhost/44103] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/java.io.tmpdir/Jetty_localhost_41537_datanode____.q1f8d/webapp 2023-10-01 16:01:25,343 INFO [Listener at localhost/44103] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41537 2023-10-01 16:01:25,787 WARN [Listener at localhost/38157] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-01 16:01:25,806 WARN [Listener at localhost/38157] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-01 16:01:25,809 WARN [Listener at localhost/38157] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 16:01:25,812 INFO [Listener at localhost/38157] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 16:01:25,823 INFO [Listener at localhost/38157] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/java.io.tmpdir/Jetty_localhost_33653_datanode____.cddov9/webapp 2023-10-01 16:01:25,923 INFO [Listener at localhost/38157] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33653 2023-10-01 16:01:25,932 WARN [Listener at localhost/35817] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-01 16:01:25,956 WARN [Listener at localhost/35817] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-01 16:01:25,960 WARN [Listener at localhost/35817] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 16:01:25,963 INFO [Listener at localhost/35817] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 16:01:25,970 INFO [Listener at localhost/35817] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/java.io.tmpdir/Jetty_localhost_34821_datanode____.76z7oj/webapp 2023-10-01 16:01:26,094 INFO [Listener at localhost/35817] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34821 2023-10-01 16:01:26,106 WARN [Listener at localhost/35661] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-01 16:01:26,384 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x634faae13eca3b05: Processing first storage report for DS-e1c1e2eb-ae28-4246-9595-dea442911ea9 from datanode 639bbc82-c3c4-4c86-8526-31d653a0782b 2023-10-01 16:01:26,386 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x634faae13eca3b05: from storage DS-e1c1e2eb-ae28-4246-9595-dea442911ea9 node DatanodeRegistration(127.0.0.1:41179, datanodeUuid=639bbc82-c3c4-4c86-8526-31d653a0782b, infoPort=41717, infoSecurePort=0, ipcPort=38157, storageInfo=lv=-57;cid=testClusterID;nsid=967666124;c=1696176083966), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-10-01 16:01:26,386 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x86b8fe5576c869d6: Processing first storage report for DS-2e356be0-58fb-48b4-897b-5c88f215bfab from datanode 9af86bd0-04d3-4a33-9fe0-4f1029e12f89 2023-10-01 16:01:26,386 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x86b8fe5576c869d6: from storage DS-2e356be0-58fb-48b4-897b-5c88f215bfab node DatanodeRegistration(127.0.0.1:40499, datanodeUuid=9af86bd0-04d3-4a33-9fe0-4f1029e12f89, infoPort=35315, infoSecurePort=0, ipcPort=35817, storageInfo=lv=-57;cid=testClusterID;nsid=967666124;c=1696176083966), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-01 16:01:26,386 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6a347e404e0155b6: Processing first storage report for DS-ca968b0d-547f-4194-ad0a-56c6ee353b49 from datanode af549173-8281-4f72-b7a1-cc0fa29d1848 2023-10-01 16:01:26,387 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6a347e404e0155b6: from storage DS-ca968b0d-547f-4194-ad0a-56c6ee353b49 node DatanodeRegistration(127.0.0.1:44767, datanodeUuid=af549173-8281-4f72-b7a1-cc0fa29d1848, infoPort=40253, infoSecurePort=0, ipcPort=35661, storageInfo=lv=-57;cid=testClusterID;nsid=967666124;c=1696176083966), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-01 16:01:26,387 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x634faae13eca3b05: Processing first storage report for DS-af19505b-5722-4b99-b80d-b5f818983a24 from datanode 639bbc82-c3c4-4c86-8526-31d653a0782b 2023-10-01 16:01:26,387 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x634faae13eca3b05: from storage DS-af19505b-5722-4b99-b80d-b5f818983a24 node DatanodeRegistration(127.0.0.1:41179, datanodeUuid=639bbc82-c3c4-4c86-8526-31d653a0782b, infoPort=41717, infoSecurePort=0, ipcPort=38157, storageInfo=lv=-57;cid=testClusterID;nsid=967666124;c=1696176083966), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-01 16:01:26,387 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x86b8fe5576c869d6: Processing first storage report for DS-2974c5a2-3438-443f-9753-69e75c0d0f39 from datanode 9af86bd0-04d3-4a33-9fe0-4f1029e12f89 2023-10-01 16:01:26,387 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x86b8fe5576c869d6: from storage DS-2974c5a2-3438-443f-9753-69e75c0d0f39 node DatanodeRegistration(127.0.0.1:40499, datanodeUuid=9af86bd0-04d3-4a33-9fe0-4f1029e12f89, infoPort=35315, infoSecurePort=0, ipcPort=35817, storageInfo=lv=-57;cid=testClusterID;nsid=967666124;c=1696176083966), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-01 16:01:26,387 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6a347e404e0155b6: Processing first storage report for DS-0a9b7fec-68a6-45d5-99d2-7db9053bdc35 from datanode af549173-8281-4f72-b7a1-cc0fa29d1848 2023-10-01 16:01:26,387 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6a347e404e0155b6: from storage DS-0a9b7fec-68a6-45d5-99d2-7db9053bdc35 node DatanodeRegistration(127.0.0.1:44767, datanodeUuid=af549173-8281-4f72-b7a1-cc0fa29d1848, infoPort=40253, infoSecurePort=0, ipcPort=35661, storageInfo=lv=-57;cid=testClusterID;nsid=967666124;c=1696176083966), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-01 16:01:26,630 DEBUG [Listener at localhost/35661] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d 2023-10-01 16:01:26,730 INFO [Listener at localhost/35661] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/cluster_dc626531-59bc-a717-57a6-1c05e4c967d9/zookeeper_0, clientPort=60886, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/cluster_dc626531-59bc-a717-57a6-1c05e4c967d9/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/cluster_dc626531-59bc-a717-57a6-1c05e4c967d9/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-01 16:01:26,749 INFO [Listener at localhost/35661] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60886 2023-10-01 16:01:26,757 INFO [Listener at localhost/35661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 16:01:26,759 INFO [Listener at localhost/35661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 16:01:27,462 INFO [Listener at localhost/35661] util.FSUtils(471): Created version file at hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc with version=8 2023-10-01 16:01:27,463 INFO [Listener at localhost/35661] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/hbase-staging 2023-10-01 16:01:27,851 INFO [Listener at localhost/35661] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-01 16:01:28,331 INFO [Listener at localhost/35661] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-10-01 16:01:28,365 INFO [Listener at localhost/35661] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 16:01:28,365 INFO [Listener at localhost/35661] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-01 16:01:28,365 INFO [Listener at localhost/35661] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-01 16:01:28,366 INFO [Listener at localhost/35661] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 16:01:28,366 INFO [Listener at localhost/35661] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-01 16:01:28,508 INFO [Listener at localhost/35661] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-01 16:01:28,581 DEBUG [Listener at localhost/35661] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-01 16:01:28,678 INFO [Listener at localhost/35661] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42819 2023-10-01 16:01:28,691 INFO [Listener at localhost/35661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 16:01:28,693 INFO [Listener at localhost/35661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 16:01:28,716 INFO [Listener at localhost/35661] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42819 connecting to ZooKeeper ensemble=127.0.0.1:60886 2023-10-01 16:01:28,786 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:428190x0, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-01 16:01:28,789 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:42819-0x10102b856590000 connected 2023-10-01 16:01:28,818 DEBUG [Listener at localhost/35661] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-01 16:01:28,819 DEBUG [Listener at localhost/35661] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 16:01:28,836 DEBUG [Listener at localhost/35661] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-01 16:01:28,844 DEBUG [Listener at localhost/35661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42819 2023-10-01 16:01:28,844 DEBUG [Listener at localhost/35661] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42819 2023-10-01 16:01:28,845 DEBUG [Listener at localhost/35661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42819 2023-10-01 16:01:28,845 DEBUG [Listener at localhost/35661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42819 2023-10-01 16:01:28,846 DEBUG [Listener at localhost/35661] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42819 2023-10-01 16:01:28,853 INFO [Listener at localhost/35661] master.HMaster(444): hbase.rootdir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc, hbase.cluster.distributed=false 2023-10-01 16:01:28,918 INFO [Listener at localhost/35661] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-01 16:01:28,918 INFO [Listener at localhost/35661] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 16:01:28,919 INFO [Listener at localhost/35661] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-01 16:01:28,919 INFO [Listener at localhost/35661] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-01 16:01:28,919 INFO [Listener at localhost/35661] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 16:01:28,919 INFO [Listener at localhost/35661] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-01 16:01:28,924 INFO [Listener at localhost/35661] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-01 16:01:28,927 INFO [Listener at localhost/35661] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38419 2023-10-01 16:01:28,929 INFO [Listener at localhost/35661] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-01 16:01:28,936 INFO [Listener at localhost/35661] mob.MobFileCache(125): MobFileCache disabled 2023-10-01 16:01:28,937 INFO [Listener at localhost/35661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 16:01:28,939 INFO [Listener at localhost/35661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 16:01:28,941 INFO [Listener at localhost/35661] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38419 connecting to ZooKeeper ensemble=127.0.0.1:60886 2023-10-01 16:01:28,947 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:384190x0, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-01 16:01:28,948 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38419-0x10102b856590001 connected 2023-10-01 16:01:28,948 DEBUG [Listener at localhost/35661] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-01 16:01:28,950 DEBUG [Listener at localhost/35661] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 16:01:28,951 DEBUG [Listener at localhost/35661] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-01 16:01:28,951 DEBUG [Listener at localhost/35661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38419 2023-10-01 16:01:28,953 DEBUG [Listener at localhost/35661] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38419 2023-10-01 16:01:28,953 DEBUG [Listener at localhost/35661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38419 2023-10-01 16:01:28,954 DEBUG [Listener at localhost/35661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38419 2023-10-01 16:01:28,954 DEBUG [Listener at localhost/35661] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38419 2023-10-01 16:01:28,974 INFO [Listener at localhost/35661] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-01 16:01:28,974 INFO [Listener at localhost/35661] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 16:01:28,974 INFO [Listener at localhost/35661] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-01 16:01:28,975 INFO [Listener at localhost/35661] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-01 16:01:28,975 INFO [Listener at localhost/35661] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 16:01:28,976 INFO [Listener at localhost/35661] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-01 16:01:28,976 INFO [Listener at localhost/35661] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-01 16:01:28,978 INFO [Listener at localhost/35661] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37191 2023-10-01 16:01:28,978 INFO [Listener at localhost/35661] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-01 16:01:28,980 INFO [Listener at localhost/35661] mob.MobFileCache(125): MobFileCache disabled 2023-10-01 16:01:28,981 INFO [Listener at localhost/35661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 16:01:28,983 INFO [Listener at localhost/35661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 16:01:28,986 INFO [Listener at localhost/35661] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37191 connecting to ZooKeeper ensemble=127.0.0.1:60886 2023-10-01 16:01:28,990 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:371910x0, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-01 16:01:28,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37191-0x10102b856590002 connected 2023-10-01 16:01:28,991 DEBUG [Listener at localhost/35661] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-01 16:01:28,992 DEBUG [Listener at localhost/35661] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 16:01:28,993 DEBUG [Listener at localhost/35661] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-01 16:01:28,993 DEBUG [Listener at localhost/35661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37191 2023-10-01 16:01:28,994 DEBUG [Listener at localhost/35661] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37191 2023-10-01 16:01:28,994 DEBUG [Listener at localhost/35661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37191 2023-10-01 16:01:28,995 DEBUG [Listener at localhost/35661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37191 2023-10-01 16:01:28,995 DEBUG [Listener at localhost/35661] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37191 2023-10-01 16:01:29,007 INFO [Listener at localhost/35661] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-01 16:01:29,007 INFO [Listener at localhost/35661] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 16:01:29,007 INFO [Listener at localhost/35661] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-01 16:01:29,007 INFO [Listener at localhost/35661] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-01 16:01:29,007 INFO [Listener at localhost/35661] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 16:01:29,007 INFO [Listener at localhost/35661] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-01 16:01:29,008 INFO [Listener at localhost/35661] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-01 16:01:29,009 INFO [Listener at localhost/35661] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45599 2023-10-01 16:01:29,009 INFO [Listener at localhost/35661] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-01 16:01:29,010 INFO [Listener at localhost/35661] mob.MobFileCache(125): MobFileCache disabled 2023-10-01 16:01:29,011 INFO [Listener at localhost/35661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 16:01:29,013 INFO [Listener at localhost/35661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 16:01:29,015 INFO [Listener at localhost/35661] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45599 connecting to ZooKeeper ensemble=127.0.0.1:60886 2023-10-01 16:01:29,018 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:455990x0, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-01 16:01:29,020 DEBUG [Listener at localhost/35661] zookeeper.ZKUtil(164): regionserver:455990x0, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-01 16:01:29,020 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45599-0x10102b856590003 connected 2023-10-01 16:01:29,021 DEBUG [Listener at localhost/35661] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 16:01:29,021 DEBUG [Listener at localhost/35661] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-01 16:01:29,022 DEBUG [Listener at localhost/35661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45599 2023-10-01 16:01:29,024 DEBUG [Listener at localhost/35661] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45599 2023-10-01 16:01:29,025 DEBUG [Listener at localhost/35661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45599 2023-10-01 16:01:29,026 DEBUG [Listener at localhost/35661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45599 2023-10-01 16:01:29,029 DEBUG [Listener at localhost/35661] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45599 2023-10-01 16:01:29,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42819,1696176087651 2023-10-01 16:01:29,045 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-01 16:01:29,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42819,1696176087651 2023-10-01 16:01:29,072 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-01 16:01:29,072 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-01 16:01:29,072 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-01 16:01:29,072 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-01 16:01:29,074 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 16:01:29,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-01 16:01:29,076 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42819,1696176087651 from backup master directory 2023-10-01 16:01:29,077 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-01 16:01:29,081 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42819,1696176087651 2023-10-01 16:01:29,081 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-01 16:01:29,082 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-01 16:01:29,082 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,42819,1696176087651 2023-10-01 16:01:29,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-01 16:01:29,087 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-01 16:01:29,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/hbase.id with ID: ad9a33f4-88f8-49d8-9605-227e8890e80d 2023-10-01 16:01:29,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 16:01:29,248 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 16:01:29,305 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x42ac966b to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:01:29,341 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d9e4c68, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:01:29,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-01 16:01:29,369 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-01 16:01:29,387 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-01 16:01:29,387 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-01 16:01:29,389 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-01 16:01:29,394 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-01 16:01:29,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-01 16:01:29,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/MasterData/data/master/store-tmp 2023-10-01 16:01:29,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:01:29,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-01 16:01:29,474 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 16:01:29,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 16:01:29,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-01 16:01:29,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 16:01:29,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 16:01:29,475 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-01 16:01:29,477 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/MasterData/WALs/jenkins-hbase4.apache.org,42819,1696176087651 2023-10-01 16:01:29,506 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42819%2C1696176087651, suffix=, logDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/MasterData/WALs/jenkins-hbase4.apache.org,42819,1696176087651, archiveDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/MasterData/oldWALs, maxLogs=10 2023-10-01 16:01:29,569 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40499,DS-2e356be0-58fb-48b4-897b-5c88f215bfab,DISK] 2023-10-01 16:01:29,569 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41179,DS-e1c1e2eb-ae28-4246-9595-dea442911ea9,DISK] 2023-10-01 16:01:29,569 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44767,DS-ca968b0d-547f-4194-ad0a-56c6ee353b49,DISK] 2023-10-01 16:01:29,578 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-01 16:01:29,656 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/MasterData/WALs/jenkins-hbase4.apache.org,42819,1696176087651/jenkins-hbase4.apache.org%2C42819%2C1696176087651.1696176089517 2023-10-01 16:01:29,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40499,DS-2e356be0-58fb-48b4-897b-5c88f215bfab,DISK], DatanodeInfoWithStorage[127.0.0.1:41179,DS-e1c1e2eb-ae28-4246-9595-dea442911ea9,DISK], DatanodeInfoWithStorage[127.0.0.1:44767,DS-ca968b0d-547f-4194-ad0a-56c6ee353b49,DISK]] 2023-10-01 16:01:29,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-01 16:01:29,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:01:29,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-01 16:01:29,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-01 16:01:29,724 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-01 16:01:29,731 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-01 16:01:29,760 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-01 16:01:29,773 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 16:01:29,779 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-01 16:01:29,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-01 16:01:29,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-01 16:01:29,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 16:01:29,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64247215, jitterRate=-0.04264189302921295}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 16:01:29,800 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-01 16:01:29,802 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-01 16:01:29,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-01 16:01:29,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-01 16:01:29,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-01 16:01:29,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-01 16:01:29,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 37 msec 2023-10-01 16:01:29,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-01 16:01:29,897 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-01 16:01:29,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-01 16:01:29,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-01 16:01:29,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-01 16:01:29,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-01 16:01:29,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-01 16:01:29,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-01 16:01:29,948 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 16:01:29,950 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-01 16:01:29,950 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-01 16:01:29,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-01 16:01:29,968 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-01 16:01:29,969 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-01 16:01:29,969 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-01 16:01:29,969 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-01 16:01:29,969 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 16:01:29,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,42819,1696176087651, sessionid=0x10102b856590000, setting cluster-up flag (Was=false) 2023-10-01 16:01:29,986 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 16:01:29,993 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-01 16:01:29,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42819,1696176087651 2023-10-01 16:01:30,000 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 16:01:30,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-01 16:01:30,006 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42819,1696176087651 2023-10-01 16:01:30,009 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp 2023-10-01 16:01:30,033 INFO [RS:1;jenkins-hbase4:37191] regionserver.HRegionServer(951): ClusterId : ad9a33f4-88f8-49d8-9605-227e8890e80d 2023-10-01 16:01:30,034 INFO [RS:2;jenkins-hbase4:45599] regionserver.HRegionServer(951): ClusterId : ad9a33f4-88f8-49d8-9605-227e8890e80d 2023-10-01 16:01:30,033 INFO [RS:0;jenkins-hbase4:38419] regionserver.HRegionServer(951): ClusterId : ad9a33f4-88f8-49d8-9605-227e8890e80d 2023-10-01 16:01:30,041 DEBUG [RS:1;jenkins-hbase4:37191] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-01 16:01:30,041 DEBUG [RS:2;jenkins-hbase4:45599] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-01 16:01:30,041 DEBUG [RS:0;jenkins-hbase4:38419] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-01 16:01:30,050 DEBUG [RS:0;jenkins-hbase4:38419] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-01 16:01:30,050 DEBUG [RS:1;jenkins-hbase4:37191] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-01 16:01:30,050 DEBUG [RS:2;jenkins-hbase4:45599] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-01 16:01:30,050 DEBUG [RS:1;jenkins-hbase4:37191] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-01 16:01:30,050 DEBUG [RS:0;jenkins-hbase4:38419] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-01 16:01:30,050 DEBUG [RS:2;jenkins-hbase4:45599] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-01 16:01:30,054 DEBUG [RS:2;jenkins-hbase4:45599] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-01 16:01:30,054 DEBUG [RS:0;jenkins-hbase4:38419] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-01 16:01:30,054 DEBUG [RS:1;jenkins-hbase4:37191] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-01 16:01:30,057 DEBUG [RS:0;jenkins-hbase4:38419] zookeeper.ReadOnlyZKClient(139): Connect 0x798d3354 to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:01:30,058 DEBUG [RS:1;jenkins-hbase4:37191] zookeeper.ReadOnlyZKClient(139): Connect 0x66866b15 to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:01:30,058 DEBUG [RS:2;jenkins-hbase4:45599] zookeeper.ReadOnlyZKClient(139): Connect 0x45cf7bd4 to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:01:30,070 DEBUG [RS:1;jenkins-hbase4:37191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@684199b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:01:30,070 DEBUG [RS:0;jenkins-hbase4:38419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@774ad215, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:01:30,070 DEBUG [RS:1;jenkins-hbase4:37191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c7e0065, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-01 16:01:30,070 DEBUG [RS:0;jenkins-hbase4:38419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73755824, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-01 16:01:30,096 DEBUG [RS:2;jenkins-hbase4:45599] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b089d1d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:01:30,097 DEBUG [RS:2;jenkins-hbase4:45599] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f3710a4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-01 16:01:30,123 DEBUG [RS:2;jenkins-hbase4:45599] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:45599 2023-10-01 16:01:30,126 DEBUG [RS:1;jenkins-hbase4:37191] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:37191 2023-10-01 16:01:30,127 DEBUG [RS:0;jenkins-hbase4:38419] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38419 2023-10-01 16:01:30,130 INFO [RS:1;jenkins-hbase4:37191] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-01 16:01:30,130 INFO [RS:2;jenkins-hbase4:45599] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-01 16:01:30,131 INFO [RS:2;jenkins-hbase4:45599] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-01 16:01:30,130 INFO [RS:0;jenkins-hbase4:38419] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-01 16:01:30,131 INFO [RS:1;jenkins-hbase4:37191] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-01 16:01:30,131 INFO [RS:0;jenkins-hbase4:38419] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-01 16:01:30,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-10-01 16:01:30,136 DEBUG [RS:2;jenkins-hbase4:45599] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-01 16:01:30,136 DEBUG [RS:0;jenkins-hbase4:38419] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-01 16:01:30,136 DEBUG [RS:1;jenkins-hbase4:37191] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-01 16:01:30,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 16:01:30,138 INFO [RS:0;jenkins-hbase4:38419] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 16:01:30,138 INFO [RS:1;jenkins-hbase4:37191] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 16:01:30,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-10-01 16:01:30,138 INFO [RS:2;jenkins-hbase4:45599] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 16:01:30,139 DEBUG [RS:1;jenkins-hbase4:37191] regionserver.HRegionServer(1022): About to register with Master. 2023-10-01 16:01:30,139 DEBUG [RS:0;jenkins-hbase4:38419] regionserver.HRegionServer(1022): About to register with Master. 2023-10-01 16:01:30,139 DEBUG [RS:2;jenkins-hbase4:45599] regionserver.HRegionServer(1022): About to register with Master. 2023-10-01 16:01:30,142 INFO [RS:2;jenkins-hbase4:45599] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42819,1696176087651 with isa=jenkins-hbase4.apache.org/172.31.14.131:45599, startcode=1696176089006 2023-10-01 16:01:30,142 INFO [RS:1;jenkins-hbase4:37191] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42819,1696176087651 with isa=jenkins-hbase4.apache.org/172.31.14.131:37191, startcode=1696176088973 2023-10-01 16:01:30,142 INFO [RS:0;jenkins-hbase4:38419] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42819,1696176087651 with isa=jenkins-hbase4.apache.org/172.31.14.131:38419, startcode=1696176088917 2023-10-01 16:01:30,163 DEBUG [RS:0;jenkins-hbase4:38419] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-01 16:01:30,163 DEBUG [RS:1;jenkins-hbase4:37191] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-01 16:01:30,163 DEBUG [RS:2;jenkins-hbase4:45599] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-01 16:01:30,226 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34423, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-10-01 16:01:30,226 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38775, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-10-01 16:01:30,227 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36139, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-01 16:01:30,237 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42819] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-01 16:01:30,237 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-01 16:01:30,245 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42819] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-01 16:01:30,246 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42819] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-01 16:01:30,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-01 16:01:30,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-01 16:01:30,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-01 16:01:30,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-01 16:01:30,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-10-01 16:01:30,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-01 16:01:30,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1696176120252 2023-10-01 16:01:30,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-01 16:01:30,266 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-01 16:01:30,266 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-01 16:01:30,267 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-01 16:01:30,271 DEBUG [RS:2;jenkins-hbase4:45599] regionserver.HRegionServer(2830): Master is not running yet 2023-10-01 16:01:30,271 DEBUG [RS:0;jenkins-hbase4:38419] regionserver.HRegionServer(2830): Master is not running yet 2023-10-01 16:01:30,271 WARN [RS:2;jenkins-hbase4:45599] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-01 16:01:30,271 DEBUG [RS:1;jenkins-hbase4:37191] regionserver.HRegionServer(2830): Master is not running yet 2023-10-01 16:01:30,271 WARN [RS:0;jenkins-hbase4:38419] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-01 16:01:30,271 WARN [RS:1;jenkins-hbase4:37191] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-01 16:01:30,273 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-01 16:01:30,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-01 16:01:30,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-01 16:01:30,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-01 16:01:30,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-01 16:01:30,278 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-01 16:01:30,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-01 16:01:30,282 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-01 16:01:30,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-01 16:01:30,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-01 16:01:30,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-01 16:01:30,287 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696176090287,5,FailOnTimeoutGroup] 2023-10-01 16:01:30,289 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696176090287,5,FailOnTimeoutGroup] 2023-10-01 16:01:30,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-01 16:01:30,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-01 16:01:30,291 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-01 16:01:30,291 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-01 16:01:30,313 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-01 16:01:30,315 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-01 16:01:30,315 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc 2023-10-01 16:01:30,335 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:01:30,338 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-01 16:01:30,340 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/1588230740/info 2023-10-01 16:01:30,341 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-01 16:01:30,342 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 16:01:30,342 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-01 16:01:30,345 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/1588230740/rep_barrier 2023-10-01 16:01:30,346 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-01 16:01:30,346 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 16:01:30,347 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-01 16:01:30,349 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/1588230740/table 2023-10-01 16:01:30,349 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-01 16:01:30,350 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 16:01:30,351 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/1588230740 2023-10-01 16:01:30,352 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/1588230740 2023-10-01 16:01:30,356 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-01 16:01:30,358 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-01 16:01:30,363 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 16:01:30,364 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61284324, jitterRate=-0.08679240942001343}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-01 16:01:30,364 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-01 16:01:30,364 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-01 16:01:30,364 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-01 16:01:30,364 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-01 16:01:30,364 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-01 16:01:30,365 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-01 16:01:30,367 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-01 16:01:30,367 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-01 16:01:30,373 INFO [RS:1;jenkins-hbase4:37191] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42819,1696176087651 with isa=jenkins-hbase4.apache.org/172.31.14.131:37191, startcode=1696176088973 2023-10-01 16:01:30,373 INFO [RS:0;jenkins-hbase4:38419] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42819,1696176087651 with isa=jenkins-hbase4.apache.org/172.31.14.131:38419, startcode=1696176088917 2023-10-01 16:01:30,373 INFO [RS:2;jenkins-hbase4:45599] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42819,1696176087651 with isa=jenkins-hbase4.apache.org/172.31.14.131:45599, startcode=1696176089006 2023-10-01 16:01:30,374 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-01 16:01:30,374 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-01 16:01:30,380 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42819] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:30,388 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42819] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:30,389 DEBUG [RS:2;jenkins-hbase4:45599] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc 2023-10-01 16:01:30,389 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-01 16:01:30,390 DEBUG [RS:2;jenkins-hbase4:45599] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44103 2023-10-01 16:01:30,389 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42819] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:30,390 DEBUG [RS:0;jenkins-hbase4:38419] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc 2023-10-01 16:01:30,390 DEBUG [RS:0;jenkins-hbase4:38419] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44103 2023-10-01 16:01:30,391 DEBUG [RS:0;jenkins-hbase4:38419] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-01 16:01:30,390 DEBUG [RS:2;jenkins-hbase4:45599] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-01 16:01:30,392 DEBUG [RS:1;jenkins-hbase4:37191] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc 2023-10-01 16:01:30,392 DEBUG [RS:1;jenkins-hbase4:37191] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44103 2023-10-01 16:01:30,392 DEBUG [RS:1;jenkins-hbase4:37191] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-01 16:01:30,404 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-01 16:01:30,407 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 16:01:30,408 DEBUG [RS:2;jenkins-hbase4:45599] zookeeper.ZKUtil(162): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:30,408 WARN [RS:2;jenkins-hbase4:45599] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-01 16:01:30,408 INFO [RS:2;jenkins-hbase4:45599] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-01 16:01:30,408 DEBUG [RS:2;jenkins-hbase4:45599] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/WALs/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:30,408 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-01 16:01:30,409 DEBUG [RS:1;jenkins-hbase4:37191] zookeeper.ZKUtil(162): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:30,410 WARN [RS:1;jenkins-hbase4:37191] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-01 16:01:30,411 DEBUG [RS:0;jenkins-hbase4:38419] zookeeper.ZKUtil(162): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:30,411 WARN [RS:0;jenkins-hbase4:38419] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-01 16:01:30,412 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37191,1696176088973] 2023-10-01 16:01:30,412 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38419,1696176088917] 2023-10-01 16:01:30,412 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45599,1696176089006] 2023-10-01 16:01:30,410 INFO [RS:1;jenkins-hbase4:37191] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-01 16:01:30,411 INFO [RS:0;jenkins-hbase4:38419] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-01 16:01:30,413 DEBUG [RS:1;jenkins-hbase4:37191] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/WALs/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:30,413 DEBUG [RS:0;jenkins-hbase4:38419] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/WALs/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:30,426 DEBUG [RS:0;jenkins-hbase4:38419] zookeeper.ZKUtil(162): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:30,426 DEBUG [RS:2;jenkins-hbase4:45599] zookeeper.ZKUtil(162): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:30,426 DEBUG [RS:1;jenkins-hbase4:37191] zookeeper.ZKUtil(162): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:30,427 DEBUG [RS:0;jenkins-hbase4:38419] zookeeper.ZKUtil(162): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:30,427 DEBUG [RS:2;jenkins-hbase4:45599] zookeeper.ZKUtil(162): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:30,427 DEBUG [RS:1;jenkins-hbase4:37191] zookeeper.ZKUtil(162): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:30,427 DEBUG [RS:0;jenkins-hbase4:38419] zookeeper.ZKUtil(162): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:30,428 DEBUG [RS:2;jenkins-hbase4:45599] zookeeper.ZKUtil(162): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:30,428 DEBUG [RS:1;jenkins-hbase4:37191] zookeeper.ZKUtil(162): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:30,440 DEBUG [RS:1;jenkins-hbase4:37191] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-01 16:01:30,440 DEBUG [RS:0;jenkins-hbase4:38419] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-01 16:01:30,440 DEBUG [RS:2;jenkins-hbase4:45599] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-01 16:01:30,451 INFO [RS:1;jenkins-hbase4:37191] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-01 16:01:30,451 INFO [RS:2;jenkins-hbase4:45599] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-01 16:01:30,451 INFO [RS:0;jenkins-hbase4:38419] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-01 16:01:30,474 INFO [RS:1;jenkins-hbase4:37191] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-01 16:01:30,474 INFO [RS:0;jenkins-hbase4:38419] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-01 16:01:30,474 INFO [RS:2;jenkins-hbase4:45599] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-01 16:01:30,479 INFO [RS:0;jenkins-hbase4:38419] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-01 16:01:30,479 INFO [RS:2;jenkins-hbase4:45599] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-01 16:01:30,480 INFO [RS:0;jenkins-hbase4:38419] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 16:01:30,479 INFO [RS:1;jenkins-hbase4:37191] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-01 16:01:30,480 INFO [RS:2;jenkins-hbase4:45599] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 16:01:30,480 INFO [RS:1;jenkins-hbase4:37191] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 16:01:30,483 INFO [RS:2;jenkins-hbase4:45599] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-01 16:01:30,483 INFO [RS:0;jenkins-hbase4:38419] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-01 16:01:30,483 INFO [RS:1;jenkins-hbase4:37191] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-01 16:01:30,492 INFO [RS:1;jenkins-hbase4:37191] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-01 16:01:30,492 INFO [RS:0;jenkins-hbase4:38419] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-01 16:01:30,492 INFO [RS:2;jenkins-hbase4:45599] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-01 16:01:30,492 DEBUG [RS:1;jenkins-hbase4:37191] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,492 DEBUG [RS:0;jenkins-hbase4:38419] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,492 DEBUG [RS:1;jenkins-hbase4:37191] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,492 DEBUG [RS:2;jenkins-hbase4:45599] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,493 DEBUG [RS:1;jenkins-hbase4:37191] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,493 DEBUG [RS:2;jenkins-hbase4:45599] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,493 DEBUG [RS:1;jenkins-hbase4:37191] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,493 DEBUG [RS:2;jenkins-hbase4:45599] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,493 DEBUG [RS:1;jenkins-hbase4:37191] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,493 DEBUG [RS:2;jenkins-hbase4:45599] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,493 DEBUG [RS:1;jenkins-hbase4:37191] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-01 16:01:30,493 DEBUG [RS:2;jenkins-hbase4:45599] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,493 DEBUG [RS:1;jenkins-hbase4:37191] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,493 DEBUG [RS:2;jenkins-hbase4:45599] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-01 16:01:30,493 DEBUG [RS:0;jenkins-hbase4:38419] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,493 DEBUG [RS:2;jenkins-hbase4:45599] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,493 DEBUG [RS:1;jenkins-hbase4:37191] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,493 DEBUG [RS:2;jenkins-hbase4:45599] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,493 DEBUG [RS:1;jenkins-hbase4:37191] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,494 DEBUG [RS:2;jenkins-hbase4:45599] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,493 DEBUG [RS:0;jenkins-hbase4:38419] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,494 DEBUG [RS:2;jenkins-hbase4:45599] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,494 DEBUG [RS:1;jenkins-hbase4:37191] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,494 DEBUG [RS:0;jenkins-hbase4:38419] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,494 DEBUG [RS:0;jenkins-hbase4:38419] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,495 DEBUG [RS:0;jenkins-hbase4:38419] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-01 16:01:30,495 DEBUG [RS:0;jenkins-hbase4:38419] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,495 DEBUG [RS:0;jenkins-hbase4:38419] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,495 DEBUG [RS:0;jenkins-hbase4:38419] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,496 DEBUG [RS:0;jenkins-hbase4:38419] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 16:01:30,496 INFO [RS:2;jenkins-hbase4:45599] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 16:01:30,497 INFO [RS:2;jenkins-hbase4:45599] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 16:01:30,497 INFO [RS:1;jenkins-hbase4:37191] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 16:01:30,497 INFO [RS:2;jenkins-hbase4:45599] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-01 16:01:30,497 INFO [RS:1;jenkins-hbase4:37191] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 16:01:30,497 INFO [RS:1;jenkins-hbase4:37191] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-01 16:01:30,498 INFO [RS:0;jenkins-hbase4:38419] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 16:01:30,498 INFO [RS:0;jenkins-hbase4:38419] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 16:01:30,498 INFO [RS:0;jenkins-hbase4:38419] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-01 16:01:30,517 INFO [RS:1;jenkins-hbase4:37191] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-01 16:01:30,517 INFO [RS:0;jenkins-hbase4:38419] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-01 16:01:30,517 INFO [RS:2;jenkins-hbase4:45599] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-01 16:01:30,521 INFO [RS:1;jenkins-hbase4:37191] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37191,1696176088973-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 16:01:30,521 INFO [RS:2;jenkins-hbase4:45599] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45599,1696176089006-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 16:01:30,521 INFO [RS:0;jenkins-hbase4:38419] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38419,1696176088917-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 16:01:30,542 INFO [RS:1;jenkins-hbase4:37191] regionserver.Replication(203): jenkins-hbase4.apache.org,37191,1696176088973 started 2023-10-01 16:01:30,542 INFO [RS:1;jenkins-hbase4:37191] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37191,1696176088973, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37191, sessionid=0x10102b856590002 2023-10-01 16:01:30,543 DEBUG [RS:1;jenkins-hbase4:37191] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-01 16:01:30,543 DEBUG [RS:1;jenkins-hbase4:37191] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:30,543 DEBUG [RS:1;jenkins-hbase4:37191] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37191,1696176088973' 2023-10-01 16:01:30,543 DEBUG [RS:1;jenkins-hbase4:37191] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-01 16:01:30,544 DEBUG [RS:1;jenkins-hbase4:37191] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-01 16:01:30,545 DEBUG [RS:1;jenkins-hbase4:37191] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-01 16:01:30,545 DEBUG [RS:1;jenkins-hbase4:37191] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-01 16:01:30,545 INFO [RS:0;jenkins-hbase4:38419] regionserver.Replication(203): jenkins-hbase4.apache.org,38419,1696176088917 started 2023-10-01 16:01:30,545 DEBUG [RS:1;jenkins-hbase4:37191] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:30,545 INFO [RS:2;jenkins-hbase4:45599] regionserver.Replication(203): jenkins-hbase4.apache.org,45599,1696176089006 started 2023-10-01 16:01:30,545 INFO [RS:2;jenkins-hbase4:45599] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45599,1696176089006, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45599, sessionid=0x10102b856590003 2023-10-01 16:01:30,545 DEBUG [RS:1;jenkins-hbase4:37191] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37191,1696176088973' 2023-10-01 16:01:30,545 DEBUG [RS:1;jenkins-hbase4:37191] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:01:30,545 INFO [RS:0;jenkins-hbase4:38419] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,38419,1696176088917, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38419, sessionid=0x10102b856590001 2023-10-01 16:01:30,545 DEBUG [RS:2;jenkins-hbase4:45599] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-01 16:01:30,546 DEBUG [RS:0;jenkins-hbase4:38419] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-01 16:01:30,546 DEBUG [RS:0;jenkins-hbase4:38419] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:30,546 DEBUG [RS:2;jenkins-hbase4:45599] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:30,547 DEBUG [RS:0;jenkins-hbase4:38419] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38419,1696176088917' 2023-10-01 16:01:30,547 DEBUG [RS:2;jenkins-hbase4:45599] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45599,1696176089006' 2023-10-01 16:01:30,547 DEBUG [RS:1;jenkins-hbase4:37191] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:01:30,547 DEBUG [RS:2;jenkins-hbase4:45599] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-01 16:01:30,547 DEBUG [RS:0;jenkins-hbase4:38419] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-01 16:01:30,548 DEBUG [RS:2;jenkins-hbase4:45599] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-01 16:01:30,548 DEBUG [RS:1;jenkins-hbase4:37191] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-01 16:01:30,548 DEBUG [RS:0;jenkins-hbase4:38419] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-01 16:01:30,549 INFO [RS:1;jenkins-hbase4:37191] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-01 16:01:30,549 INFO [RS:1;jenkins-hbase4:37191] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-01 16:01:30,549 DEBUG [RS:2;jenkins-hbase4:45599] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-01 16:01:30,549 DEBUG [RS:2;jenkins-hbase4:45599] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-01 16:01:30,549 DEBUG [RS:2;jenkins-hbase4:45599] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:30,550 DEBUG [RS:0;jenkins-hbase4:38419] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-01 16:01:30,550 DEBUG [RS:2;jenkins-hbase4:45599] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45599,1696176089006' 2023-10-01 16:01:30,550 DEBUG [RS:2;jenkins-hbase4:45599] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:01:30,550 DEBUG [RS:0;jenkins-hbase4:38419] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-01 16:01:30,550 DEBUG [RS:0;jenkins-hbase4:38419] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:30,550 DEBUG [RS:0;jenkins-hbase4:38419] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38419,1696176088917' 2023-10-01 16:01:30,550 DEBUG [RS:0;jenkins-hbase4:38419] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:01:30,551 DEBUG [RS:2;jenkins-hbase4:45599] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:01:30,551 DEBUG [RS:0;jenkins-hbase4:38419] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:01:30,551 DEBUG [RS:2;jenkins-hbase4:45599] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-01 16:01:30,552 DEBUG [RS:0;jenkins-hbase4:38419] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-01 16:01:30,551 INFO [RS:2;jenkins-hbase4:45599] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-01 16:01:30,553 INFO [RS:0;jenkins-hbase4:38419] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-01 16:01:30,553 INFO [RS:0;jenkins-hbase4:38419] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-01 16:01:30,553 INFO [RS:2;jenkins-hbase4:45599] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-01 16:01:30,561 DEBUG [jenkins-hbase4:42819] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-10-01 16:01:30,566 DEBUG [jenkins-hbase4:42819] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 16:01:30,572 DEBUG [jenkins-hbase4:42819] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 16:01:30,572 DEBUG [jenkins-hbase4:42819] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 16:01:30,572 DEBUG [jenkins-hbase4:42819] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 16:01:30,572 DEBUG [jenkins-hbase4:42819] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 16:01:30,575 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38419,1696176088917, state=OPENING 2023-10-01 16:01:30,583 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-01 16:01:30,585 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 16:01:30,585 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-01 16:01:30,590 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38419,1696176088917}] 2023-10-01 16:01:30,660 INFO [RS:1;jenkins-hbase4:37191] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37191%2C1696176088973, suffix=, logDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/WALs/jenkins-hbase4.apache.org,37191,1696176088973, archiveDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/oldWALs, maxLogs=32 2023-10-01 16:01:30,661 INFO [RS:2;jenkins-hbase4:45599] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45599%2C1696176089006, suffix=, logDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/WALs/jenkins-hbase4.apache.org,45599,1696176089006, archiveDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/oldWALs, maxLogs=32 2023-10-01 16:01:30,660 INFO [RS:0;jenkins-hbase4:38419] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38419%2C1696176088917, suffix=, logDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/WALs/jenkins-hbase4.apache.org,38419,1696176088917, archiveDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/oldWALs, maxLogs=32 2023-10-01 16:01:30,690 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41179,DS-e1c1e2eb-ae28-4246-9595-dea442911ea9,DISK] 2023-10-01 16:01:30,690 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44767,DS-ca968b0d-547f-4194-ad0a-56c6ee353b49,DISK] 2023-10-01 16:01:30,690 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40499,DS-2e356be0-58fb-48b4-897b-5c88f215bfab,DISK] 2023-10-01 16:01:30,697 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44767,DS-ca968b0d-547f-4194-ad0a-56c6ee353b49,DISK] 2023-10-01 16:01:30,699 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41179,DS-e1c1e2eb-ae28-4246-9595-dea442911ea9,DISK] 2023-10-01 16:01:30,699 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40499,DS-2e356be0-58fb-48b4-897b-5c88f215bfab,DISK] 2023-10-01 16:01:30,702 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44767,DS-ca968b0d-547f-4194-ad0a-56c6ee353b49,DISK] 2023-10-01 16:01:30,702 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41179,DS-e1c1e2eb-ae28-4246-9595-dea442911ea9,DISK] 2023-10-01 16:01:30,702 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40499,DS-2e356be0-58fb-48b4-897b-5c88f215bfab,DISK] 2023-10-01 16:01:30,719 INFO [RS:1;jenkins-hbase4:37191] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/WALs/jenkins-hbase4.apache.org,37191,1696176088973/jenkins-hbase4.apache.org%2C37191%2C1696176088973.1696176090666 2023-10-01 16:01:30,719 INFO [RS:2;jenkins-hbase4:45599] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/WALs/jenkins-hbase4.apache.org,45599,1696176089006/jenkins-hbase4.apache.org%2C45599%2C1696176089006.1696176090666 2023-10-01 16:01:30,719 INFO [RS:0;jenkins-hbase4:38419] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/WALs/jenkins-hbase4.apache.org,38419,1696176088917/jenkins-hbase4.apache.org%2C38419%2C1696176088917.1696176090666 2023-10-01 16:01:30,721 DEBUG [RS:1;jenkins-hbase4:37191] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41179,DS-e1c1e2eb-ae28-4246-9595-dea442911ea9,DISK], DatanodeInfoWithStorage[127.0.0.1:44767,DS-ca968b0d-547f-4194-ad0a-56c6ee353b49,DISK], DatanodeInfoWithStorage[127.0.0.1:40499,DS-2e356be0-58fb-48b4-897b-5c88f215bfab,DISK]] 2023-10-01 16:01:30,721 DEBUG [RS:0;jenkins-hbase4:38419] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44767,DS-ca968b0d-547f-4194-ad0a-56c6ee353b49,DISK], DatanodeInfoWithStorage[127.0.0.1:40499,DS-2e356be0-58fb-48b4-897b-5c88f215bfab,DISK], DatanodeInfoWithStorage[127.0.0.1:41179,DS-e1c1e2eb-ae28-4246-9595-dea442911ea9,DISK]] 2023-10-01 16:01:30,721 DEBUG [RS:2;jenkins-hbase4:45599] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44767,DS-ca968b0d-547f-4194-ad0a-56c6ee353b49,DISK], DatanodeInfoWithStorage[127.0.0.1:40499,DS-2e356be0-58fb-48b4-897b-5c88f215bfab,DISK], DatanodeInfoWithStorage[127.0.0.1:41179,DS-e1c1e2eb-ae28-4246-9595-dea442911ea9,DISK]] 2023-10-01 16:01:30,774 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:30,777 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 16:01:30,781 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59476, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 16:01:30,793 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-01 16:01:30,794 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-01 16:01:30,797 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38419%2C1696176088917.meta, suffix=.meta, logDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/WALs/jenkins-hbase4.apache.org,38419,1696176088917, archiveDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/oldWALs, maxLogs=32 2023-10-01 16:01:30,816 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44767,DS-ca968b0d-547f-4194-ad0a-56c6ee353b49,DISK] 2023-10-01 16:01:30,817 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41179,DS-e1c1e2eb-ae28-4246-9595-dea442911ea9,DISK] 2023-10-01 16:01:30,818 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40499,DS-2e356be0-58fb-48b4-897b-5c88f215bfab,DISK] 2023-10-01 16:01:30,823 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/WALs/jenkins-hbase4.apache.org,38419,1696176088917/jenkins-hbase4.apache.org%2C38419%2C1696176088917.meta.1696176090798.meta 2023-10-01 16:01:30,825 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44767,DS-ca968b0d-547f-4194-ad0a-56c6ee353b49,DISK], DatanodeInfoWithStorage[127.0.0.1:41179,DS-e1c1e2eb-ae28-4246-9595-dea442911ea9,DISK], DatanodeInfoWithStorage[127.0.0.1:40499,DS-2e356be0-58fb-48b4-897b-5c88f215bfab,DISK]] 2023-10-01 16:01:30,825 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-01 16:01:30,826 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-10-01 16:01:30,828 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 16:01:30,828 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-01 16:01:30,830 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-01 16:01:30,832 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-01 16:01:30,846 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-01 16:01:30,846 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:01:30,846 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-01 16:01:30,846 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-01 16:01:30,852 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-01 16:01:30,854 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/1588230740/info 2023-10-01 16:01:30,854 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/1588230740/info 2023-10-01 16:01:30,854 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-01 16:01:30,855 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 16:01:30,856 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-01 16:01:30,857 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/1588230740/rep_barrier 2023-10-01 16:01:30,857 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/1588230740/rep_barrier 2023-10-01 16:01:30,858 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-01 16:01:30,859 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 16:01:30,859 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-01 16:01:30,861 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/1588230740/table 2023-10-01 16:01:30,861 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/1588230740/table 2023-10-01 16:01:30,861 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-01 16:01:30,862 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 16:01:30,864 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/1588230740 2023-10-01 16:01:30,867 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/1588230740 2023-10-01 16:01:30,870 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-01 16:01:30,873 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-01 16:01:30,874 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59427768, jitterRate=-0.11445724964141846}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-01 16:01:30,877 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-01 16:01:30,886 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1696176090766 2023-10-01 16:01:30,905 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-01 16:01:30,906 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-01 16:01:30,907 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38419,1696176088917, state=OPEN 2023-10-01 16:01:30,910 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-01 16:01:30,910 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-01 16:01:30,914 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-01 16:01:30,914 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38419,1696176088917 in 320 msec 2023-10-01 16:01:30,919 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-01 16:01:30,919 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 527 msec 2023-10-01 16:01:30,924 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 776 msec 2023-10-01 16:01:30,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1696176090924, completionTime=-1 2023-10-01 16:01:30,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-10-01 16:01:30,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-10-01 16:01:30,996 DEBUG [hconnection-0x4c068432-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:01:30,999 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59486, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:01:31,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-10-01 16:01:31,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1696176151052 2023-10-01 16:01:31,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1696176211052 2023-10-01 16:01:31,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 127 msec 2023-10-01 16:01:31,080 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42819,1696176087651-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 16:01:31,081 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42819,1696176087651-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-01 16:01:31,081 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42819,1696176087651-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-01 16:01:31,083 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42819, period=300000, unit=MILLISECONDS is enabled. 2023-10-01 16:01:31,083 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-01 16:01:31,089 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-01 16:01:31,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-01 16:01:31,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-01 16:01:31,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-01 16:01:31,117 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 16:01:31,120 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 16:01:31,149 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/hbase/namespace/0f8721e5a3a091a4ec523f0203fe22fb 2023-10-01 16:01:31,152 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/hbase/namespace/0f8721e5a3a091a4ec523f0203fe22fb empty. 2023-10-01 16:01:31,152 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/hbase/namespace/0f8721e5a3a091a4ec523f0203fe22fb 2023-10-01 16:01:31,152 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-01 16:01:31,192 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-01 16:01:31,194 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0f8721e5a3a091a4ec523f0203fe22fb, NAME => 'hbase:namespace,,1696176091101.0f8721e5a3a091a4ec523f0203fe22fb.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp 2023-10-01 16:01:31,220 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696176091101.0f8721e5a3a091a4ec523f0203fe22fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:01:31,220 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 0f8721e5a3a091a4ec523f0203fe22fb, disabling compactions & flushes 2023-10-01 16:01:31,220 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696176091101.0f8721e5a3a091a4ec523f0203fe22fb. 2023-10-01 16:01:31,220 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696176091101.0f8721e5a3a091a4ec523f0203fe22fb. 2023-10-01 16:01:31,220 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696176091101.0f8721e5a3a091a4ec523f0203fe22fb. after waiting 0 ms 2023-10-01 16:01:31,220 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696176091101.0f8721e5a3a091a4ec523f0203fe22fb. 2023-10-01 16:01:31,220 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696176091101.0f8721e5a3a091a4ec523f0203fe22fb. 2023-10-01 16:01:31,220 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 0f8721e5a3a091a4ec523f0203fe22fb: 2023-10-01 16:01:31,225 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 16:01:31,240 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1696176091101.0f8721e5a3a091a4ec523f0203fe22fb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696176091228"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176091228"}]},"ts":"1696176091228"} 2023-10-01 16:01:31,272 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-01 16:01:31,274 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 16:01:31,279 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176091274"}]},"ts":"1696176091274"} 2023-10-01 16:01:31,284 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-01 16:01:31,290 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 16:01:31,291 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 16:01:31,291 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 16:01:31,291 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 16:01:31,291 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 16:01:31,294 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0f8721e5a3a091a4ec523f0203fe22fb, ASSIGN}] 2023-10-01 16:01:31,297 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0f8721e5a3a091a4ec523f0203fe22fb, ASSIGN 2023-10-01 16:01:31,299 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=0f8721e5a3a091a4ec523f0203fe22fb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37191,1696176088973; forceNewPlan=false, retain=false 2023-10-01 16:01:31,451 INFO [jenkins-hbase4:42819] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-01 16:01:31,452 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0f8721e5a3a091a4ec523f0203fe22fb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:31,453 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1696176091101.0f8721e5a3a091a4ec523f0203fe22fb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696176091452"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176091452"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176091452"}]},"ts":"1696176091452"} 2023-10-01 16:01:31,459 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 0f8721e5a3a091a4ec523f0203fe22fb, server=jenkins-hbase4.apache.org,37191,1696176088973}] 2023-10-01 16:01:31,614 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:31,614 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 16:01:31,617 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60654, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 16:01:31,624 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1696176091101.0f8721e5a3a091a4ec523f0203fe22fb. 2023-10-01 16:01:31,624 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0f8721e5a3a091a4ec523f0203fe22fb, NAME => 'hbase:namespace,,1696176091101.0f8721e5a3a091a4ec523f0203fe22fb.', STARTKEY => '', ENDKEY => ''} 2023-10-01 16:01:31,625 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1696176091101.0f8721e5a3a091a4ec523f0203fe22fb. service=AccessControlService 2023-10-01 16:01:31,626 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 16:01:31,626 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 0f8721e5a3a091a4ec523f0203fe22fb 2023-10-01 16:01:31,626 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696176091101.0f8721e5a3a091a4ec523f0203fe22fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:01:31,626 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0f8721e5a3a091a4ec523f0203fe22fb 2023-10-01 16:01:31,626 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0f8721e5a3a091a4ec523f0203fe22fb 2023-10-01 16:01:31,629 INFO [StoreOpener-0f8721e5a3a091a4ec523f0203fe22fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 0f8721e5a3a091a4ec523f0203fe22fb 2023-10-01 16:01:31,631 DEBUG [StoreOpener-0f8721e5a3a091a4ec523f0203fe22fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/namespace/0f8721e5a3a091a4ec523f0203fe22fb/info 2023-10-01 16:01:31,632 DEBUG [StoreOpener-0f8721e5a3a091a4ec523f0203fe22fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/namespace/0f8721e5a3a091a4ec523f0203fe22fb/info 2023-10-01 16:01:31,632 INFO [StoreOpener-0f8721e5a3a091a4ec523f0203fe22fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f8721e5a3a091a4ec523f0203fe22fb columnFamilyName info 2023-10-01 16:01:31,633 INFO [StoreOpener-0f8721e5a3a091a4ec523f0203fe22fb-1] regionserver.HStore(310): Store=0f8721e5a3a091a4ec523f0203fe22fb/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 16:01:31,635 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/namespace/0f8721e5a3a091a4ec523f0203fe22fb 2023-10-01 16:01:31,636 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/namespace/0f8721e5a3a091a4ec523f0203fe22fb 2023-10-01 16:01:31,641 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0f8721e5a3a091a4ec523f0203fe22fb 2023-10-01 16:01:31,646 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/namespace/0f8721e5a3a091a4ec523f0203fe22fb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 16:01:31,647 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0f8721e5a3a091a4ec523f0203fe22fb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72342712, jitterRate=0.07799041271209717}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 16:01:31,647 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0f8721e5a3a091a4ec523f0203fe22fb: 2023-10-01 16:01:31,650 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1696176091101.0f8721e5a3a091a4ec523f0203fe22fb., pid=6, masterSystemTime=1696176091613 2023-10-01 16:01:31,655 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1696176091101.0f8721e5a3a091a4ec523f0203fe22fb. 2023-10-01 16:01:31,655 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1696176091101.0f8721e5a3a091a4ec523f0203fe22fb. 2023-10-01 16:01:31,657 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0f8721e5a3a091a4ec523f0203fe22fb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:31,657 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1696176091101.0f8721e5a3a091a4ec523f0203fe22fb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696176091656"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696176091656"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696176091656"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696176091656"}]},"ts":"1696176091656"} 2023-10-01 16:01:31,664 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-01 16:01:31,664 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 0f8721e5a3a091a4ec523f0203fe22fb, server=jenkins-hbase4.apache.org,37191,1696176088973 in 202 msec 2023-10-01 16:01:31,668 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-01 16:01:31,669 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=0f8721e5a3a091a4ec523f0203fe22fb, ASSIGN in 370 msec 2023-10-01 16:01:31,670 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 16:01:31,671 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176091670"}]},"ts":"1696176091670"} 2023-10-01 16:01:31,674 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-01 16:01:31,677 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 16:01:31,680 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 574 msec 2023-10-01 16:01:31,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-01 16:01:31,720 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-01 16:01:31,720 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 16:01:31,741 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:01:31,744 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60670, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:01:31,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-01 16:01:31,782 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-01 16:01:31,790 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 39 msec 2023-10-01 16:01:31,794 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-01 16:01:31,807 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-01 16:01:31,813 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-10-01 16:01:31,820 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-01 16:01:31,823 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-01 16:01:31,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.741sec 2023-10-01 16:01:31,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-01 16:01:31,830 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-01 16:01:31,830 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-01 16:01:31,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42819,1696176087651-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-01 16:01:31,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42819,1696176087651-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-01 16:01:31,851 DEBUG [Listener at localhost/35661] zookeeper.ReadOnlyZKClient(139): Connect 0x21c22958 to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:01:31,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-01 16:01:31,857 DEBUG [Listener at localhost/35661] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bcebd71, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:01:31,858 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-10-01 16:01:31,860 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 16:01:31,864 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 16:01:31,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-10-01 16:01:31,869 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/hbase/acl/69908950ff7a37f7d0523ae70d9fab14 2023-10-01 16:01:31,870 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/hbase/acl/69908950ff7a37f7d0523ae70d9fab14 empty. 2023-10-01 16:01:31,873 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/hbase/acl/69908950ff7a37f7d0523ae70d9fab14 2023-10-01 16:01:31,873 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-10-01 16:01:31,879 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-01 16:01:31,884 DEBUG [hconnection-0x60d85d60-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:01:31,903 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-10-01 16:01:31,905 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 69908950ff7a37f7d0523ae70d9fab14, NAME => 'hbase:acl,,1696176091848.69908950ff7a37f7d0523ae70d9fab14.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp 2023-10-01 16:01:31,910 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59498, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:01:31,912 INFO [Listener at localhost/35661] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42819,1696176087651 2023-10-01 16:01:31,913 INFO [Listener at localhost/35661] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-10-01 16:01:31,913 INFO [Listener at localhost/35661] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/test.cache.data in system properties and HBase conf 2023-10-01 16:01:31,914 INFO [Listener at localhost/35661] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/hadoop.tmp.dir in system properties and HBase conf 2023-10-01 16:01:31,914 INFO [Listener at localhost/35661] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/hadoop.log.dir in system properties and HBase conf 2023-10-01 16:01:31,914 INFO [Listener at localhost/35661] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-01 16:01:31,914 INFO [Listener at localhost/35661] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-01 16:01:31,914 INFO [Listener at localhost/35661] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-01 16:01:31,914 INFO [Listener at localhost/35661] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-01 16:01:31,914 INFO [Listener at localhost/35661] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-01 16:01:31,914 INFO [Listener at localhost/35661] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-01 16:01:31,914 INFO [Listener at localhost/35661] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-01 16:01:31,914 INFO [Listener at localhost/35661] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-01 16:01:31,914 INFO [Listener at localhost/35661] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-01 16:01:31,914 INFO [Listener at localhost/35661] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-01 16:01:31,914 INFO [Listener at localhost/35661] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-01 16:01:31,915 INFO [Listener at localhost/35661] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-01 16:01:31,915 INFO [Listener at localhost/35661] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/nfs.dump.dir in system properties and HBase conf 2023-10-01 16:01:31,915 INFO [Listener at localhost/35661] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/java.io.tmpdir in system properties and HBase conf 2023-10-01 16:01:31,915 INFO [Listener at localhost/35661] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-01 16:01:31,915 INFO [Listener at localhost/35661] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-01 16:01:31,915 INFO [Listener at localhost/35661] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-10-01 16:01:31,931 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696176091848.69908950ff7a37f7d0523ae70d9fab14.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:01:31,931 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 69908950ff7a37f7d0523ae70d9fab14, disabling compactions & flushes 2023-10-01 16:01:31,931 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696176091848.69908950ff7a37f7d0523ae70d9fab14. 2023-10-01 16:01:31,931 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696176091848.69908950ff7a37f7d0523ae70d9fab14. 2023-10-01 16:01:31,931 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696176091848.69908950ff7a37f7d0523ae70d9fab14. after waiting 0 ms 2023-10-01 16:01:31,931 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696176091848.69908950ff7a37f7d0523ae70d9fab14. 2023-10-01 16:01:31,931 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1696176091848.69908950ff7a37f7d0523ae70d9fab14. 2023-10-01 16:01:31,931 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 69908950ff7a37f7d0523ae70d9fab14: 2023-10-01 16:01:31,936 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 16:01:31,938 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1696176091848.69908950ff7a37f7d0523ae70d9fab14.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696176091937"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176091937"}]},"ts":"1696176091937"} 2023-10-01 16:01:31,940 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-01 16:01:31,942 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 16:01:31,942 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176091942"}]},"ts":"1696176091942"} 2023-10-01 16:01:31,944 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-10-01 16:01:31,949 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 16:01:31,950 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 16:01:31,950 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 16:01:31,950 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 16:01:31,950 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 16:01:31,950 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=69908950ff7a37f7d0523ae70d9fab14, ASSIGN}] 2023-10-01 16:01:31,953 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=69908950ff7a37f7d0523ae70d9fab14, ASSIGN 2023-10-01 16:01:31,954 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=69908950ff7a37f7d0523ae70d9fab14, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37191,1696176088973; forceNewPlan=false, retain=false 2023-10-01 16:01:31,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-01 16:01:32,105 INFO [jenkins-hbase4:42819] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-01 16:01:32,106 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=69908950ff7a37f7d0523ae70d9fab14, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:32,106 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1696176091848.69908950ff7a37f7d0523ae70d9fab14.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696176092106"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176092106"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176092106"}]},"ts":"1696176092106"} 2023-10-01 16:01:32,110 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 69908950ff7a37f7d0523ae70d9fab14, server=jenkins-hbase4.apache.org,37191,1696176088973}] 2023-10-01 16:01:32,184 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-01 16:01:32,270 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1696176091848.69908950ff7a37f7d0523ae70d9fab14. 2023-10-01 16:01:32,270 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 69908950ff7a37f7d0523ae70d9fab14, NAME => 'hbase:acl,,1696176091848.69908950ff7a37f7d0523ae70d9fab14.', STARTKEY => '', ENDKEY => ''} 2023-10-01 16:01:32,271 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1696176091848.69908950ff7a37f7d0523ae70d9fab14. service=AccessControlService 2023-10-01 16:01:32,271 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 16:01:32,271 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 69908950ff7a37f7d0523ae70d9fab14 2023-10-01 16:01:32,271 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696176091848.69908950ff7a37f7d0523ae70d9fab14.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:01:32,271 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 69908950ff7a37f7d0523ae70d9fab14 2023-10-01 16:01:32,271 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 69908950ff7a37f7d0523ae70d9fab14 2023-10-01 16:01:32,274 INFO [StoreOpener-69908950ff7a37f7d0523ae70d9fab14-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 69908950ff7a37f7d0523ae70d9fab14 2023-10-01 16:01:32,276 DEBUG [StoreOpener-69908950ff7a37f7d0523ae70d9fab14-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/acl/69908950ff7a37f7d0523ae70d9fab14/l 2023-10-01 16:01:32,276 DEBUG [StoreOpener-69908950ff7a37f7d0523ae70d9fab14-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/acl/69908950ff7a37f7d0523ae70d9fab14/l 2023-10-01 16:01:32,277 INFO [StoreOpener-69908950ff7a37f7d0523ae70d9fab14-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 69908950ff7a37f7d0523ae70d9fab14 columnFamilyName l 2023-10-01 16:01:32,278 INFO [StoreOpener-69908950ff7a37f7d0523ae70d9fab14-1] regionserver.HStore(310): Store=69908950ff7a37f7d0523ae70d9fab14/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 16:01:32,280 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/acl/69908950ff7a37f7d0523ae70d9fab14 2023-10-01 16:01:32,282 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/acl/69908950ff7a37f7d0523ae70d9fab14 2023-10-01 16:01:32,287 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 69908950ff7a37f7d0523ae70d9fab14 2023-10-01 16:01:32,292 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/acl/69908950ff7a37f7d0523ae70d9fab14/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 16:01:32,293 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 69908950ff7a37f7d0523ae70d9fab14; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69207988, jitterRate=0.03127938508987427}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 16:01:32,293 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 69908950ff7a37f7d0523ae70d9fab14: 2023-10-01 16:01:32,295 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1696176091848.69908950ff7a37f7d0523ae70d9fab14., pid=11, masterSystemTime=1696176092264 2023-10-01 16:01:32,298 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1696176091848.69908950ff7a37f7d0523ae70d9fab14. 2023-10-01 16:01:32,298 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1696176091848.69908950ff7a37f7d0523ae70d9fab14. 2023-10-01 16:01:32,299 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=69908950ff7a37f7d0523ae70d9fab14, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:32,299 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1696176091848.69908950ff7a37f7d0523ae70d9fab14.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696176092299"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696176092299"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696176092299"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696176092299"}]},"ts":"1696176092299"} 2023-10-01 16:01:32,306 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-01 16:01:32,306 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 69908950ff7a37f7d0523ae70d9fab14, server=jenkins-hbase4.apache.org,37191,1696176088973 in 192 msec 2023-10-01 16:01:32,309 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-01 16:01:32,309 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=69908950ff7a37f7d0523ae70d9fab14, ASSIGN in 356 msec 2023-10-01 16:01:32,311 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 16:01:32,311 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176092311"}]},"ts":"1696176092311"} 2023-10-01 16:01:32,317 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-10-01 16:01:32,320 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 16:01:32,323 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 465 msec 2023-10-01 16:01:32,484 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-01 16:01:32,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-10-01 16:01:32,494 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-01 16:01:33,098 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 16:01:33,457 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 16:01:33,464 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35053_jobhistory____hi8y1h/webapp 2023-10-01 16:01:33,646 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-10-01 16:01:33,646 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-10-01 16:01:33,646 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-01 16:01:33,650 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-01 16:01:33,744 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 16:01:34,120 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 16:01:34,501 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-10-01 16:01:34,545 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35053 2023-10-01 16:01:36,092 WARN [Listener at jenkins-hbase4.apache.org/41519] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 16:01:36,375 WARN [Listener at jenkins-hbase4.apache.org/41519] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-01 16:01:36,376 INFO [Listener at jenkins-hbase4.apache.org/41519] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 16:01:36,381 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 16:01:36,386 INFO [Listener at jenkins-hbase4.apache.org/41519] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46645_cluster____.dhuwa9/webapp 2023-10-01 16:01:36,493 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-01 16:01:36,495 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-01 16:01:36,496 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-10-01 16:01:36,514 INFO [Listener at jenkins-hbase4.apache.org/41519] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-10-01 16:01:36,514 INFO [Listener at jenkins-hbase4.apache.org/41519] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-10-01 16:01:36,514 INFO [Listener at jenkins-hbase4.apache.org/41519] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-01 16:01:36,515 INFO [Listener at jenkins-hbase4.apache.org/41519] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-01 16:01:36,523 INFO [Listener at jenkins-hbase4.apache.org/41519] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 16:01:36,697 INFO [Listener at jenkins-hbase4.apache.org/41519] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 16:01:36,794 INFO [Listener at jenkins-hbase4.apache.org/41519] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 16:01:36,802 INFO [Listener at jenkins-hbase4.apache.org/41519] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46645 2023-10-01 16:01:37,262 WARN [Listener at jenkins-hbase4.apache.org/40803] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 16:01:37,288 WARN [Listener at jenkins-hbase4.apache.org/40803] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-01 16:01:37,288 INFO [Listener at jenkins-hbase4.apache.org/40803] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 16:01:37,295 INFO [Listener at jenkins-hbase4.apache.org/40803] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33501_node____lojbo4/webapp 2023-10-01 16:01:37,348 INFO [Listener at jenkins-hbase4.apache.org/40803] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-01 16:01:37,348 INFO [Listener at jenkins-hbase4.apache.org/40803] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-01 16:01:37,348 INFO [Listener at jenkins-hbase4.apache.org/40803] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-01 16:01:37,348 INFO [Listener at jenkins-hbase4.apache.org/40803] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-01 16:01:37,356 INFO [Listener at jenkins-hbase4.apache.org/40803] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 16:01:37,376 INFO [Listener at jenkins-hbase4.apache.org/40803] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 16:01:37,440 INFO [Listener at jenkins-hbase4.apache.org/40803] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 16:01:37,450 INFO [Listener at jenkins-hbase4.apache.org/40803] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33501 2023-10-01 16:01:37,613 WARN [Listener at jenkins-hbase4.apache.org/36093] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 16:01:37,618 WARN [Listener at jenkins-hbase4.apache.org/36093] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-01 16:01:37,619 INFO [Listener at jenkins-hbase4.apache.org/36093] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 16:01:37,626 INFO [Listener at jenkins-hbase4.apache.org/36093] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38033_node____.uncr7b/webapp 2023-10-01 16:01:37,677 INFO [Listener at jenkins-hbase4.apache.org/36093] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-01 16:01:37,677 INFO [Listener at jenkins-hbase4.apache.org/36093] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-01 16:01:37,677 INFO [Listener at jenkins-hbase4.apache.org/36093] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-01 16:01:37,677 INFO [Listener at jenkins-hbase4.apache.org/36093] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-01 16:01:37,688 INFO [Listener at jenkins-hbase4.apache.org/36093] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 16:01:37,712 INFO [Listener at jenkins-hbase4.apache.org/36093] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 16:01:37,799 INFO [Listener at jenkins-hbase4.apache.org/36093] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 16:01:37,804 INFO [Listener at jenkins-hbase4.apache.org/36093] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38033 2023-10-01 16:01:37,836 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-10-01 16:01:37,838 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 16:01:37,847 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 16:01:37,848 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-10-01 16:01:37,849 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 16:01:37,849 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-10-01 16:01:37,849 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-01 16:01:37,849 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-10-01 16:01:37,850 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 16:01:37,850 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-10-01 16:01:37,850 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-01 16:01:37,850 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-01 16:01:37,908 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=897, MaxFileDescriptor=60000, SystemLoadAverage=163, ProcessCount=165, AvailableMemoryMB=2492 2023-10-01 16:01:37,908 WARN [Listener at jenkins-hbase4.apache.org/36093] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-10-01 16:01:37,922 DEBUG [Listener at jenkins-hbase4.apache.org/36093] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-01 16:01:37,929 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-01 16:01:37,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 16:01:37,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-10-01 16:01:37,945 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 16:01:37,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-10-01 16:01:37,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-01 16:01:37,948 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 16:01:37,953 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportWithTargetName/2fd37040f0979a353507324b337cc890 2023-10-01 16:01:37,953 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportWithTargetName/8dd2351c84139a4d771b87e05185024a 2023-10-01 16:01:37,955 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportWithTargetName/2fd37040f0979a353507324b337cc890 empty. 2023-10-01 16:01:37,955 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportWithTargetName/8dd2351c84139a4d771b87e05185024a empty. 2023-10-01 16:01:37,957 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportWithTargetName/2fd37040f0979a353507324b337cc890 2023-10-01 16:01:37,957 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportWithTargetName/8dd2351c84139a4d771b87e05185024a 2023-10-01 16:01:37,958 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-01 16:01:38,001 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-10-01 16:01:38,003 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2fd37040f0979a353507324b337cc890, NAME => 'testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp 2023-10-01 16:01:38,003 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8dd2351c84139a4d771b87e05185024a, NAME => 'testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp 2023-10-01 16:01:38,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-01 16:01:38,055 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:01:38,057 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 2fd37040f0979a353507324b337cc890, disabling compactions & flushes 2023-10-01 16:01:38,057 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890. 2023-10-01 16:01:38,057 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890. 2023-10-01 16:01:38,057 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890. after waiting 0 ms 2023-10-01 16:01:38,057 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890. 2023-10-01 16:01:38,057 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890. 2023-10-01 16:01:38,057 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 2fd37040f0979a353507324b337cc890: 2023-10-01 16:01:38,058 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:01:38,058 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 8dd2351c84139a4d771b87e05185024a, disabling compactions & flushes 2023-10-01 16:01:38,058 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a. 2023-10-01 16:01:38,058 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a. 2023-10-01 16:01:38,059 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a. after waiting 0 ms 2023-10-01 16:01:38,059 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a. 2023-10-01 16:01:38,059 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a. 2023-10-01 16:01:38,059 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 8dd2351c84139a4d771b87e05185024a: 2023-10-01 16:01:38,063 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 16:01:38,065 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696176098064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176098064"}]},"ts":"1696176098064"} 2023-10-01 16:01:38,065 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696176098064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176098064"}]},"ts":"1696176098064"} 2023-10-01 16:01:38,118 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 16:01:38,120 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 16:01:38,120 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176098120"}]},"ts":"1696176098120"} 2023-10-01 16:01:38,123 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-10-01 16:01:38,129 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 16:01:38,131 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 16:01:38,131 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 16:01:38,131 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 16:01:38,131 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 16:01:38,132 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2fd37040f0979a353507324b337cc890, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8dd2351c84139a4d771b87e05185024a, ASSIGN}] 2023-10-01 16:01:38,135 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8dd2351c84139a4d771b87e05185024a, ASSIGN 2023-10-01 16:01:38,135 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2fd37040f0979a353507324b337cc890, ASSIGN 2023-10-01 16:01:38,136 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8dd2351c84139a4d771b87e05185024a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37191,1696176088973; forceNewPlan=false, retain=false 2023-10-01 16:01:38,136 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2fd37040f0979a353507324b337cc890, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45599,1696176089006; forceNewPlan=false, retain=false 2023-10-01 16:01:38,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-01 16:01:38,287 INFO [jenkins-hbase4:42819] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 16:01:38,289 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=8dd2351c84139a4d771b87e05185024a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:38,289 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=2fd37040f0979a353507324b337cc890, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:38,290 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696176098289"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176098289"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176098289"}]},"ts":"1696176098289"} 2023-10-01 16:01:38,290 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696176098289"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176098289"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176098289"}]},"ts":"1696176098289"} 2023-10-01 16:01:38,292 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 8dd2351c84139a4d771b87e05185024a, server=jenkins-hbase4.apache.org,37191,1696176088973}] 2023-10-01 16:01:38,294 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 2fd37040f0979a353507324b337cc890, server=jenkins-hbase4.apache.org,45599,1696176089006}] 2023-10-01 16:01:38,448 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:38,449 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 16:01:38,450 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41394, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 16:01:38,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a. 2023-10-01 16:01:38,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8dd2351c84139a4d771b87e05185024a, NAME => 'testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 16:01:38,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a. service=AccessControlService 2023-10-01 16:01:38,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 16:01:38,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 8dd2351c84139a4d771b87e05185024a 2023-10-01 16:01:38,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:01:38,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8dd2351c84139a4d771b87e05185024a 2023-10-01 16:01:38,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8dd2351c84139a4d771b87e05185024a 2023-10-01 16:01:38,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890. 2023-10-01 16:01:38,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2fd37040f0979a353507324b337cc890, NAME => 'testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 16:01:38,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890. service=AccessControlService 2023-10-01 16:01:38,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 16:01:38,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 2fd37040f0979a353507324b337cc890 2023-10-01 16:01:38,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:01:38,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2fd37040f0979a353507324b337cc890 2023-10-01 16:01:38,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2fd37040f0979a353507324b337cc890 2023-10-01 16:01:38,459 INFO [StoreOpener-8dd2351c84139a4d771b87e05185024a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8dd2351c84139a4d771b87e05185024a 2023-10-01 16:01:38,459 INFO [StoreOpener-2fd37040f0979a353507324b337cc890-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2fd37040f0979a353507324b337cc890 2023-10-01 16:01:38,461 DEBUG [StoreOpener-8dd2351c84139a4d771b87e05185024a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportWithTargetName/8dd2351c84139a4d771b87e05185024a/cf 2023-10-01 16:01:38,461 DEBUG [StoreOpener-8dd2351c84139a4d771b87e05185024a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportWithTargetName/8dd2351c84139a4d771b87e05185024a/cf 2023-10-01 16:01:38,462 DEBUG [StoreOpener-2fd37040f0979a353507324b337cc890-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportWithTargetName/2fd37040f0979a353507324b337cc890/cf 2023-10-01 16:01:38,462 DEBUG [StoreOpener-2fd37040f0979a353507324b337cc890-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportWithTargetName/2fd37040f0979a353507324b337cc890/cf 2023-10-01 16:01:38,466 INFO [StoreOpener-2fd37040f0979a353507324b337cc890-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2fd37040f0979a353507324b337cc890 columnFamilyName cf 2023-10-01 16:01:38,466 INFO [StoreOpener-8dd2351c84139a4d771b87e05185024a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8dd2351c84139a4d771b87e05185024a columnFamilyName cf 2023-10-01 16:01:38,469 INFO [StoreOpener-2fd37040f0979a353507324b337cc890-1] regionserver.HStore(310): Store=2fd37040f0979a353507324b337cc890/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 16:01:38,469 INFO [StoreOpener-8dd2351c84139a4d771b87e05185024a-1] regionserver.HStore(310): Store=8dd2351c84139a4d771b87e05185024a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 16:01:38,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportWithTargetName/8dd2351c84139a4d771b87e05185024a 2023-10-01 16:01:38,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportWithTargetName/8dd2351c84139a4d771b87e05185024a 2023-10-01 16:01:38,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportWithTargetName/2fd37040f0979a353507324b337cc890 2023-10-01 16:01:38,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportWithTargetName/2fd37040f0979a353507324b337cc890 2023-10-01 16:01:38,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8dd2351c84139a4d771b87e05185024a 2023-10-01 16:01:38,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2fd37040f0979a353507324b337cc890 2023-10-01 16:01:38,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportWithTargetName/2fd37040f0979a353507324b337cc890/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 16:01:38,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportWithTargetName/8dd2351c84139a4d771b87e05185024a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 16:01:38,485 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2fd37040f0979a353507324b337cc890; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73394843, jitterRate=0.0936683863401413}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 16:01:38,485 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8dd2351c84139a4d771b87e05185024a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74548081, jitterRate=0.11085297167301178}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 16:01:38,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2fd37040f0979a353507324b337cc890: 2023-10-01 16:01:38,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8dd2351c84139a4d771b87e05185024a: 2023-10-01 16:01:38,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a., pid=15, masterSystemTime=1696176098446 2023-10-01 16:01:38,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890., pid=16, masterSystemTime=1696176098448 2023-10-01 16:01:38,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a. 2023-10-01 16:01:38,493 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a. 2023-10-01 16:01:38,494 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=8dd2351c84139a4d771b87e05185024a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:38,494 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696176098494"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696176098494"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696176098494"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696176098494"}]},"ts":"1696176098494"} 2023-10-01 16:01:38,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890. 2023-10-01 16:01:38,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890. 2023-10-01 16:01:38,496 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=2fd37040f0979a353507324b337cc890, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:38,497 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696176098496"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696176098496"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696176098496"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696176098496"}]},"ts":"1696176098496"} 2023-10-01 16:01:38,503 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-10-01 16:01:38,503 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 8dd2351c84139a4d771b87e05185024a, server=jenkins-hbase4.apache.org,37191,1696176088973 in 207 msec 2023-10-01 16:01:38,504 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-10-01 16:01:38,508 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 2fd37040f0979a353507324b337cc890, server=jenkins-hbase4.apache.org,45599,1696176089006 in 207 msec 2023-10-01 16:01:38,509 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8dd2351c84139a4d771b87e05185024a, ASSIGN in 371 msec 2023-10-01 16:01:38,512 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-10-01 16:01:38,512 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2fd37040f0979a353507324b337cc890, ASSIGN in 376 msec 2023-10-01 16:01:38,513 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 16:01:38,513 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176098513"}]},"ts":"1696176098513"} 2023-10-01 16:01:38,515 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-10-01 16:01:38,517 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 16:01:38,522 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-10-01 16:01:38,531 DEBUG [hconnection-0x100ad554-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:01:38,533 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52098, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-10-01 16:01:38,541 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37191] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-01 16:01:38,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-01 16:01:38,576 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-01 16:01:38,576 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-01 16:01:38,576 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-01 16:01:38,576 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-01 16:01:38,576 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 16:01:38,584 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 16:01:38,584 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 16:01:38,584 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 16:01:38,584 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-01 16:01:38,585 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-01 16:01:38,586 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-01 16:01:38,587 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-01 16:01:38,588 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 645 msec 2023-10-01 16:01:39,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-01 16:01:39,058 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-10-01 16:01:39,062 DEBUG [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-01 16:01:39,063 DEBUG [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890. 2023-10-01 16:01:39,066 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 16:01:39,089 DEBUG [hconnection-0x60d85d60-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:01:39,093 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41398, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:01:39,097 DEBUG [hconnection-0x60d85d60-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:01:39,099 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46588, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:01:39,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 16:01:39,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696176099115 (current time:1696176099115). 2023-10-01 16:01:39,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 16:01:39,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x2f6c9670 to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:01:39,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5017a814, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:01:39,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:01:39,128 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52110, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:01:39,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f6c9670 to 127.0.0.1:60886 2023-10-01 16:01:39,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:01:39,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x29a27a52 to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:01:39,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@220b1ca4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:01:39,237 DEBUG [hconnection-0x4a458b8a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:01:39,238 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52120, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:01:39,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:01:39,246 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46598, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:01:39,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29a27a52 to 127.0.0.1:60886 2023-10-01 16:01:39,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:01:39,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-01 16:01:39,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 16:01:39,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 16:01:39,284 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot, current working dir path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 16:01:39,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 16:01:39,305 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 16:01:39,306 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696176699306 2023-10-01 16:01:39,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 16:01:39,307 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-01 16:01:39,310 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 16:01:39,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 16:01:39,312 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-10-01 16:01:39,314 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 16:01:39,314 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 16:01:39,315 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 16:01:39,315 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696176699315 2023-10-01 16:01:39,340 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,340 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-10-01 16:01:39,340 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:01:39,341 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-10-01 16:01:39,341 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-01 16:01:39,342 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,342 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,349 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:01:39,349 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:39,349 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:01:39,349 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:01:39,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:01:39,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:01:39,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:01:39,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:01:39,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:01:39,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:01:39,351 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:39,351 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:39,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,352 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:39,352 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 16:01:39,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-01 16:01:39,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-01 16:01:39,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-01 16:01:39,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,353 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 16:01:39,354 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 16:01:39,353 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 16:01:39,357 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,357 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,357 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,358 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 16:01:39,358 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 16:01:39,358 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:01:39,358 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:01:39,359 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 16:01:39,359 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 16:01:39,359 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-01 16:01:39,359 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-01 16:01:39,360 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37191,1696176088973' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-01 16:01:39,358 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 16:01:39,359 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45599,1696176089006' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-01 16:01:39,360 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:01:39,360 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 16:01:39,361 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-01 16:01:39,361 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38419,1696176088917' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-01 16:01:39,364 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,364 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:39,364 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:39,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:01:39,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:01:39,364 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:39,364 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,364 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:01:39,365 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,365 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:01:39,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:01:39,365 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:01:39,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,367 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,367 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:01:39,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:39,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:39,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:39,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:01:39,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45599,1696176089006' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-01 16:01:39,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63d6b201[Count = 1] remaining members to acquire global barrier 2023-10-01 16:01:39,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:39,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:01:39,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:01:39,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:01:39,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:01:39,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:39,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:39,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:39,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:01:39,373 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37191,1696176088973' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-01 16:01:39,373 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63d6b201[Count = 0] remaining members to acquire global barrier 2023-10-01 16:01:39,373 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-01 16:01:39,373 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,376 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,376 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,376 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,377 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 16:01:39,377 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:39,377 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:39,377 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 16:01:39,377 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 16:01:39,377 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 16:01:39,378 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-01 16:01:39,378 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38419,1696176088917' in zk 2023-10-01 16:01:39,379 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 16:01:39,379 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 16:01:39,379 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890. 2023-10-01 16:01:39,379 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 16:01:39,379 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 16:01:39,379 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a. 2023-10-01 16:01:39,379 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a. started... 2023-10-01 16:01:39,379 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890. started... 2023-10-01 16:01:39,383 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 16:01:39,383 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:01:39,383 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-01 16:01:39,385 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8dd2351c84139a4d771b87e05185024a: 2023-10-01 16:01:39,385 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2fd37040f0979a353507324b337cc890: 2023-10-01 16:01:39,386 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,386 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,392 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 16:01:39,392 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 16:01:39,395 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 16:01:39,395 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 16:01:39,415 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 16:01:39,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-01 16:01:39,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-01 16:01:39,431 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a. completed. 2023-10-01 16:01:39,431 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 16:01:39,431 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890. completed. 2023-10-01 16:01:39,431 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a. 2023-10-01 16:01:39,432 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890. 2023-10-01 16:01:39,432 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 16:01:39,433 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 16:01:39,432 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 16:01:39,433 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 16:01:39,433 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:39,433 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:39,433 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-01 16:01:39,433 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-01 16:01:39,433 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45599,1696176089006' in zk 2023-10-01 16:01:39,433 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37191,1696176088973' in zk 2023-10-01 16:01:39,435 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:39,435 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 16:01:39,435 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 16:01:39,435 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:01:39,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:39,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:01:39,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:01:39,435 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-01 16:01:39,435 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:01:39,437 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:39,437 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-01 16:01:39,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:01:39,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:01:39,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:39,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:39,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:39,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:01:39,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:39,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:39,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:39,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37191,1696176088973': 2023-10-01 16:01:39,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37191,1696176088973' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-01 16:01:39,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:39,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:01:39,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:01:39,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:01:39,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:01:39,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:39,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:39,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:39,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:01:39,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:39,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:39,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:39,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45599,1696176089006': 2023-10-01 16:01:39,447 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45599,1696176089006' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-01 16:01:39,448 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-10-01 16:01:39,448 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 16:01:39,448 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 16:01:39,448 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,448 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 16:01:39,451 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,451 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,451 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:01:39,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:01:39,451 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:01:39,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,451 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:01:39,451 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,451 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:01:39,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:01:39,452 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:39,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:01:39,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:01:39,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:01:39,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:01:39,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:01:39,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:01:39,452 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:39,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,453 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:39,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:01:39,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:39,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:39,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:39,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:01:39,456 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:39,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,456 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:39,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:39,457 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:39,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:39,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:39,473 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:39,473 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:01:39,473 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:01:39,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:01:39,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:01:39,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:01:39,473 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:01:39,473 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,473 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:01:39,473 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-01 16:01:39,473 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:01:39,473 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:01:39,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:01:39,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 16:01:39,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:01:39,473 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:01:39,473 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:39,473 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:01:39,474 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:39,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:01:39,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:01:39,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:01:39,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:01:39,475 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,475 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:39,475 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,476 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:39,476 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:39,476 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,476 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:01:39,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:01:39,476 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 16:01:39,492 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,548 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,549 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-01 16:01:39,549 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,550 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:39,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696176099307Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696176099492 (+185 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1696176099492Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1696176099492Writing data manifest for emptySnaptb0-testExportWithTargetName at 1696176099508 (+16 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1696176099536 (+28 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696176099549 (+13 ms) 2023-10-01 16:01:39,552 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 16:01:39,555 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 244 msec 2023-10-01 16:01:39,632 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 16:01:39,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-01 16:01:39,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 16:01:39,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45599] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 16:01:39,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37191] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 16:01:39,655 DEBUG [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-01 16:01:39,655 DEBUG [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890. 2023-10-01 16:01:39,656 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 16:01:39,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 16:01:39,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696176099672 (current time:1696176099672). 2023-10-01 16:01:39,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 16:01:39,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x0469467b to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:01:39,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61d8b07a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:01:39,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:01:39,685 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52132, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:01:39,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0469467b to 127.0.0.1:60886 2023-10-01 16:01:39,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:01:39,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x60e73682 to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:01:39,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ef3ee7b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:01:39,697 DEBUG [hconnection-0xa0cc0bf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:01:39,700 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52148, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:01:39,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:01:39,707 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46610, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:01:39,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60e73682 to 127.0.0.1:60886 2023-10-01 16:01:39,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:01:39,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-01 16:01:39,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 16:01:39,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 16:01:39,712 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot, current working dir path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 16:01:39,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 16:01:39,715 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 16:01:39,717 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696176699717 2023-10-01 16:01:39,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 16:01:39,717 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-01 16:01:39,718 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 16:01:39,718 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 16:01:39,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 16:01:39,719 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 16:01:39,721 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-10-01 16:01:39,722 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 16:01:39,723 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696176699723 2023-10-01 16:01:39,744 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-10-01 16:01:39,744 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-10-01 16:01:39,744 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:01:39,745 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-10-01 16:01:39,745 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-01 16:01:39,745 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 16:01:39,745 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 16:01:39,747 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:01:39,747 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:01:39,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:01:39,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:01:39,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:01:39,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:01:39,747 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:01:39,748 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:39,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:01:39,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:01:39,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 16:01:39,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 16:01:39,748 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:39,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 16:01:39,748 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:39,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 16:01:39,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 16:01:39,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 16:01:39,749 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:39,749 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 16:01:39,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-01 16:01:39,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 16:01:39,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-01 16:01:39,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 16:01:39,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-01 16:01:39,749 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 16:01:39,749 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 16:01:39,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 16:01:39,750 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 16:01:39,750 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-01 16:01:39,750 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-01 16:01:39,750 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 16:01:39,750 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 16:01:39,750 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-01 16:01:39,750 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:01:39,753 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 16:01:39,754 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 16:01:39,754 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-01 16:01:39,750 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:01:39,754 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45599,1696176089006' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-01 16:01:39,754 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:01:39,755 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 16:01:39,755 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-01 16:01:39,755 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 16:01:39,756 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-01 16:01:39,756 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37191,1696176088973' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-01 16:01:39,756 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38419,1696176088917' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-01 16:01:39,758 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:39,758 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 16:01:39,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:39,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:01:39,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:01:39,758 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:39,758 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 16:01:39,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:01:39,759 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 16:01:39,759 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:01:39,759 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 16:01:39,759 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 16:01:39,759 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:01:39,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:01:39,759 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 16:01:39,759 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:01:39,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 16:01:39,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:39,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:39,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:39,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:01:39,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45599,1696176089006' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-01 16:01:39,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e27cb07[Count = 1] remaining members to acquire global barrier 2023-10-01 16:01:39,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:39,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:01:39,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:01:39,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:01:39,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:01:39,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 16:01:39,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:39,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:39,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:39,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:01:39,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37191,1696176088973' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-01 16:01:39,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e27cb07[Count = 0] remaining members to acquire global barrier 2023-10-01 16:01:39,764 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-01 16:01:39,764 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 16:01:39,770 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 16:01:39,770 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 16:01:39,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 16:01:39,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 16:01:39,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 16:01:39,770 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 16:01:39,770 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 16:01:39,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 16:01:39,770 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:39,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 16:01:39,770 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 16:01:39,770 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890. 2023-10-01 16:01:39,770 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 16:01:39,770 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 16:01:39,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 16:01:39,771 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:39,771 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 16:01:39,771 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890. started... 2023-10-01 16:01:39,771 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 16:01:39,771 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a. 2023-10-01 16:01:39,771 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 16:01:39,771 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a. started... 2023-10-01 16:01:39,771 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-01 16:01:39,771 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38419,1696176088917' in zk 2023-10-01 16:01:39,771 INFO [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2fd37040f0979a353507324b337cc890 1/1 column families, dataSize=132 B heapSize=544 B 2023-10-01 16:01:39,771 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 16:01:39,771 INFO [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8dd2351c84139a4d771b87e05185024a 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-10-01 16:01:39,774 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 16:01:39,774 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:01:39,774 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-01 16:01:39,818 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 16:01:39,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-01 16:01:39,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-01 16:01:39,820 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 16:01:39,909 INFO [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310012cb4d58eaec14eefaa6c0da842c20093 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310012cb4d58eaec14eefaa6c0da842c20093 2023-10-01 16:01:39,909 INFO [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100195e59dfe952d432ca5de8a15c864e132 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100195e59dfe952d432ca5de8a15c864e132 2023-10-01 16:01:39,949 INFO [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportWithTargetName/8dd2351c84139a4d771b87e05185024a/.tmp/cf/568d65634cc646d9b55588ece051d3b1 2023-10-01 16:01:39,949 INFO [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportWithTargetName/2fd37040f0979a353507324b337cc890/.tmp/cf/6cedb74f23d04ec9861047e6b1dcfa83 2023-10-01 16:01:39,961 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportWithTargetName/2fd37040f0979a353507324b337cc890/.tmp/cf/6cedb74f23d04ec9861047e6b1dcfa83 as hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportWithTargetName/2fd37040f0979a353507324b337cc890/cf/6cedb74f23d04ec9861047e6b1dcfa83 2023-10-01 16:01:39,961 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportWithTargetName/8dd2351c84139a4d771b87e05185024a/.tmp/cf/568d65634cc646d9b55588ece051d3b1 as hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportWithTargetName/8dd2351c84139a4d771b87e05185024a/cf/568d65634cc646d9b55588ece051d3b1 2023-10-01 16:01:39,969 INFO [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportWithTargetName/2fd37040f0979a353507324b337cc890/cf/6cedb74f23d04ec9861047e6b1dcfa83, entries=2, sequenceid=6, filesize=5.2 K 2023-10-01 16:01:39,971 INFO [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportWithTargetName/8dd2351c84139a4d771b87e05185024a/cf/568d65634cc646d9b55588ece051d3b1, entries=48, sequenceid=6, filesize=13.0 K 2023-10-01 16:01:39,975 INFO [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 2fd37040f0979a353507324b337cc890 in 204ms, sequenceid=6, compaction requested=false 2023-10-01 16:01:39,975 INFO [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 8dd2351c84139a4d771b87e05185024a in 204ms, sequenceid=6, compaction requested=false 2023-10-01 16:01:39,975 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-01 16:01:39,975 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-01 16:01:39,978 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2fd37040f0979a353507324b337cc890: 2023-10-01 16:01:39,978 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8dd2351c84139a4d771b87e05185024a: 2023-10-01 16:01:39,978 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-01 16:01:39,979 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 16:01:39,979 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-01 16:01:39,979 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportWithTargetName/2fd37040f0979a353507324b337cc890/cf/6cedb74f23d04ec9861047e6b1dcfa83] hfiles 2023-10-01 16:01:39,979 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 16:01:39,979 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportWithTargetName/2fd37040f0979a353507324b337cc890/cf/6cedb74f23d04ec9861047e6b1dcfa83 for snapshot=snaptb0-testExportWithTargetName 2023-10-01 16:01:39,979 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportWithTargetName/8dd2351c84139a4d771b87e05185024a/cf/568d65634cc646d9b55588ece051d3b1] hfiles 2023-10-01 16:01:39,979 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportWithTargetName/8dd2351c84139a4d771b87e05185024a/cf/568d65634cc646d9b55588ece051d3b1 for snapshot=snaptb0-testExportWithTargetName 2023-10-01 16:01:40,005 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a. completed. 2023-10-01 16:01:40,005 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a. 2023-10-01 16:01:40,006 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 16:01:40,006 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 16:01:40,006 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:40,006 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-01 16:01:40,006 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37191,1696176088973' in zk 2023-10-01 16:01:40,008 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 16:01:40,008 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:40,008 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:01:40,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:40,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:01:40,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:01:40,008 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-01 16:01:40,009 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890. completed. 2023-10-01 16:01:40,009 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890. 2023-10-01 16:01:40,009 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 16:01:40,009 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 16:01:40,009 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:40,009 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-01 16:01:40,009 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45599,1696176089006' in zk 2023-10-01 16:01:40,011 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 16:01:40,011 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:01:40,011 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-01 16:01:40,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:01:40,013 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:40,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:01:40,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 16:01:40,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:40,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:40,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:40,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:01:40,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 16:01:40,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:40,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:40,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:40,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37191,1696176088973': 2023-10-01 16:01:40,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37191,1696176088973' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-01 16:01:40,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:40,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:01:40,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:01:40,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:01:40,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:01:40,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 16:01:40,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:40,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:40,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:40,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:01:40,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 16:01:40,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:40,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:40,020 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 16:01:40,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:40,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45599,1696176089006': 2023-10-01 16:01:40,022 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45599,1696176089006' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-01 16:01:40,022 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-10-01 16:01:40,022 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 16:01:40,022 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 16:01:40,022 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-10-01 16:01:40,022 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 16:01:40,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-01 16:01:40,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-01 16:01:40,023 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-01 16:01:40,026 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 16:01:40,026 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 16:01:40,026 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 16:01:40,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 16:01:40,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 16:01:40,026 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 16:01:40,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 16:01:40,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 16:01:40,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 16:01:40,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 16:01:40,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 16:01:40,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:01:40,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:01:40,026 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:01:40,026 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:01:40,026 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:01:40,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:01:40,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:01:40,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:01:40,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:01:40,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:01:40,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:01:40,027 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:40,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:01:40,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 16:01:40,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 16:01:40,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 16:01:40,028 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:40,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 16:01:40,028 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:40,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:01:40,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 16:01:40,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:40,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:40,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:40,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:01:40,031 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:40,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 16:01:40,031 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:40,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:40,032 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:40,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:40,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:40,042 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:40,042 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:01:40,042 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 16:01:40,042 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:01:40,042 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:01:40,042 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:01:40,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:01:40,043 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:01:40,043 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-10-01 16:01:40,042 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:40,044 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-01 16:01:40,044 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:40,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:01:40,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-01 16:01:40,042 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:01:40,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 16:01:40,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:01:40,044 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 16:01:40,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:01:40,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:01:40,043 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:01:40,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:01:40,044 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:40,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:01:40,044 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 16:01:40,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:01:40,044 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:40,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:01:40,044 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:40,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:01:40,045 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 16:01:40,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:01:40,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:01:40,045 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 16:01:40,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100195e59dfe952d432ca5de8a15c864e132, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310012cb4d58eaec14eefaa6c0da842c20093] mob files 2023-10-01 16:01:40,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100195e59dfe952d432ca5de8a15c864e132 2023-10-01 16:01:40,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310012cb4d58eaec14eefaa6c0da842c20093 2023-10-01 16:01:40,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-10-01 16:01:40,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-01 16:01:40,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-01 16:01:40,099 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-01 16:01:40,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-01 16:01:40,100 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-01 16:01:40,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696176099717Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696176100059 (+342 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1696176100059Loading Region manifests for snaptb0-testExportWithTargetName at 1696176100059Writing data manifest for snaptb0-testExportWithTargetName at 1696176100065 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1696176100087 (+22 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696176100099 (+12 ms) 2023-10-01 16:01:40,103 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 16:01:40,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 386 msec 2023-10-01 16:01:40,323 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 16:01:40,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-01 16:01:40,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 16:01:40,327 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176100326 2023-10-01 16:01:40,327 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44103, tgtDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176100326, rawTgtDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176100326, srcFsUri=hdfs://localhost:44103, srcDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc 2023-10-01 16:01:40,368 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44103, inputRoot=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc 2023-10-01 16:01:40,368 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1959840044_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176100326, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176100326/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-01 16:01:40,368 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44103, inputRoot=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc, snapshotDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-10-01 16:01:40,390 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176100326/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-01 16:01:40,459 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 16:01:40,459 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 16:01:40,460 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 16:01:40,460 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 16:01:41,424 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/hadoop-3303300605507657785.jar 2023-10-01 16:01:41,425 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 16:01:41,426 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 16:01:41,493 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/hadoop-4739306742254497820.jar 2023-10-01 16:01:41,493 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 16:01:41,494 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 16:01:41,494 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 16:01:41,495 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 16:01:41,495 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 16:01:41,496 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 16:01:41,496 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 16:01:41,497 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 16:01:41,497 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 16:01:41,498 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 16:01:41,499 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 16:01:41,500 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 16:01:41,500 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 16:01:41,501 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 16:01:41,501 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 16:01:41,502 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 16:01:41,508 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:01:41,508 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:01:41,509 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 16:01:41,509 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:01:41,510 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:01:41,511 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 16:01:41,511 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 16:01:42,293 WARN [Listener at jenkins-hbase4.apache.org/36093] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 16:01:42,299 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-10-01 16:01:42,308 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-01 16:01:42,761 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 16:01:42,763 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 16:01:42,995 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0001_000001 (auth:SIMPLE) 2023-10-01 16:01:43,979 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 16:01:47,626 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0001_000001 (auth:SIMPLE) 2023-10-01 16:01:49,896 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0001_000001 (auth:SIMPLE) 2023-10-01 16:01:52,672 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0001_000001 (auth:SIMPLE) 2023-10-01 16:01:54,170 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 16:01:54,174 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 16:01:54,187 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-10-01 16:01:54,188 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 16:01:54,188 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 16:01:54,189 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1478872176_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-01 16:01:54,189 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-10-01 16:01:54,189 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-10-01 16:01:54,189 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1478872176_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176100326/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176100326/.hbase-snapshot/testExportWithTargetName 2023-10-01 16:01:54,190 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176100326/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-10-01 16:01:54,190 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176100326/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-10-01 16:01:54,201 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-10-01 16:01:54,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-10-01 16:01:54,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-10-01 16:01:54,220 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176114220"}]},"ts":"1696176114220"} 2023-10-01 16:01:54,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-01 16:01:54,222 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-10-01 16:01:54,224 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-10-01 16:01:54,226 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2fd37040f0979a353507324b337cc890, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8dd2351c84139a4d771b87e05185024a, UNASSIGN}] 2023-10-01 16:01:54,229 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8dd2351c84139a4d771b87e05185024a, UNASSIGN 2023-10-01 16:01:54,229 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2fd37040f0979a353507324b337cc890, UNASSIGN 2023-10-01 16:01:54,230 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=8dd2351c84139a4d771b87e05185024a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:54,230 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=2fd37040f0979a353507324b337cc890, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:54,230 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696176114230"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176114230"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176114230"}]},"ts":"1696176114230"} 2023-10-01 16:01:54,230 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696176114230"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176114230"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176114230"}]},"ts":"1696176114230"} 2023-10-01 16:01:54,232 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 8dd2351c84139a4d771b87e05185024a, server=jenkins-hbase4.apache.org,37191,1696176088973}] 2023-10-01 16:01:54,233 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 2fd37040f0979a353507324b337cc890, server=jenkins-hbase4.apache.org,45599,1696176089006}] 2023-10-01 16:01:54,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-01 16:01:54,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2fd37040f0979a353507324b337cc890 2023-10-01 16:01:54,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8dd2351c84139a4d771b87e05185024a 2023-10-01 16:01:54,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2fd37040f0979a353507324b337cc890, disabling compactions & flushes 2023-10-01 16:01:54,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8dd2351c84139a4d771b87e05185024a, disabling compactions & flushes 2023-10-01 16:01:54,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890. 2023-10-01 16:01:54,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a. 2023-10-01 16:01:54,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890. 2023-10-01 16:01:54,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a. 2023-10-01 16:01:54,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890. after waiting 0 ms 2023-10-01 16:01:54,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a. after waiting 0 ms 2023-10-01 16:01:54,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890. 2023-10-01 16:01:54,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a. 2023-10-01 16:01:54,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportWithTargetName/2fd37040f0979a353507324b337cc890/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 16:01:54,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportWithTargetName/8dd2351c84139a4d771b87e05185024a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 16:01:54,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 16:01:54,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 16:01:54,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a. 2023-10-01 16:01:54,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890. 2023-10-01 16:01:54,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8dd2351c84139a4d771b87e05185024a: 2023-10-01 16:01:54,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2fd37040f0979a353507324b337cc890: 2023-10-01 16:01:54,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8dd2351c84139a4d771b87e05185024a 2023-10-01 16:01:54,412 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=8dd2351c84139a4d771b87e05185024a, regionState=CLOSED 2023-10-01 16:01:54,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2fd37040f0979a353507324b337cc890 2023-10-01 16:01:54,412 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696176114412"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176114412"}]},"ts":"1696176114412"} 2023-10-01 16:01:54,414 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=2fd37040f0979a353507324b337cc890, regionState=CLOSED 2023-10-01 16:01:54,414 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696176114414"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176114414"}]},"ts":"1696176114414"} 2023-10-01 16:01:54,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-10-01 16:01:54,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 8dd2351c84139a4d771b87e05185024a, server=jenkins-hbase4.apache.org,37191,1696176088973 in 182 msec 2023-10-01 16:01:54,419 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=22 2023-10-01 16:01:54,419 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 2fd37040f0979a353507324b337cc890, server=jenkins-hbase4.apache.org,45599,1696176089006 in 183 msec 2023-10-01 16:01:54,420 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8dd2351c84139a4d771b87e05185024a, UNASSIGN in 192 msec 2023-10-01 16:01:54,422 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-10-01 16:01:54,422 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2fd37040f0979a353507324b337cc890, UNASSIGN in 193 msec 2023-10-01 16:01:54,423 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176114423"}]},"ts":"1696176114423"} 2023-10-01 16:01:54,424 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-10-01 16:01:54,426 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-10-01 16:01:54,429 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 218 msec 2023-10-01 16:01:54,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-01 16:01:54,537 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-10-01 16:01:54,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-10-01 16:01:54,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 16:01:54,553 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 16:01:54,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-10-01 16:01:54,555 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 16:01:54,559 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37191] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-10-01 16:01:54,562 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportWithTargetName/2fd37040f0979a353507324b337cc890 2023-10-01 16:01:54,562 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportWithTargetName/8dd2351c84139a4d771b87e05185024a 2023-10-01 16:01:54,562 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 16:01:54,562 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 16:01:54,562 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 16:01:54,562 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 16:01:54,563 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-01 16:01:54,563 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-01 16:01:54,568 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportWithTargetName/8dd2351c84139a4d771b87e05185024a/cf, FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportWithTargetName/8dd2351c84139a4d771b87e05185024a/recovered.edits] 2023-10-01 16:01:54,568 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportWithTargetName/2fd37040f0979a353507324b337cc890/cf, FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportWithTargetName/2fd37040f0979a353507324b337cc890/recovered.edits] 2023-10-01 16:01:54,573 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 16:01:54,573 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 16:01:54,573 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-01 16:01:54,573 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-01 16:01:54,573 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:01:54,573 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-01 16:01:54,573 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:01:54,573 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:01:54,573 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-01 16:01:54,573 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:01:54,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-01 16:01:54,577 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportWithTargetName/2fd37040f0979a353507324b337cc890/cf/6cedb74f23d04ec9861047e6b1dcfa83 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportWithTargetName/2fd37040f0979a353507324b337cc890/cf/6cedb74f23d04ec9861047e6b1dcfa83 2023-10-01 16:01:54,577 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportWithTargetName/8dd2351c84139a4d771b87e05185024a/cf/568d65634cc646d9b55588ece051d3b1 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportWithTargetName/8dd2351c84139a4d771b87e05185024a/cf/568d65634cc646d9b55588ece051d3b1 2023-10-01 16:01:54,581 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportWithTargetName/2fd37040f0979a353507324b337cc890/recovered.edits/9.seqid to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportWithTargetName/2fd37040f0979a353507324b337cc890/recovered.edits/9.seqid 2023-10-01 16:01:54,581 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportWithTargetName/8dd2351c84139a4d771b87e05185024a/recovered.edits/9.seqid to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportWithTargetName/8dd2351c84139a4d771b87e05185024a/recovered.edits/9.seqid 2023-10-01 16:01:54,582 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportWithTargetName/2fd37040f0979a353507324b337cc890 2023-10-01 16:01:54,582 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportWithTargetName/8dd2351c84139a4d771b87e05185024a 2023-10-01 16:01:54,583 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-01 16:01:54,583 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-01 16:01:54,584 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-10-01 16:01:54,589 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100195e59dfe952d432ca5de8a15c864e132 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100195e59dfe952d432ca5de8a15c864e132 2023-10-01 16:01:54,590 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310012cb4d58eaec14eefaa6c0da842c20093 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310012cb4d58eaec14eefaa6c0da842c20093 2023-10-01 16:01:54,591 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-01 16:01:54,594 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 16:01:54,626 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-10-01 16:01:54,629 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-10-01 16:01:54,631 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 16:01:54,631 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-10-01 16:01:54,631 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696176114631"}]},"ts":"9223372036854775807"} 2023-10-01 16:01:54,632 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696176114631"}]},"ts":"9223372036854775807"} 2023-10-01 16:01:54,634 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 16:01:54,634 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2fd37040f0979a353507324b337cc890, NAME => 'testtb-testExportWithTargetName,,1696176097938.2fd37040f0979a353507324b337cc890.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8dd2351c84139a4d771b87e05185024a, NAME => 'testtb-testExportWithTargetName,1,1696176097938.8dd2351c84139a4d771b87e05185024a.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 16:01:54,634 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-10-01 16:01:54,635 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696176114634"}]},"ts":"9223372036854775807"} 2023-10-01 16:01:54,639 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-10-01 16:01:54,642 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 16:01:54,644 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 98 msec 2023-10-01 16:01:54,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-01 16:01:54,680 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-10-01 16:01:54,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-10-01 16:01:54,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-10-01 16:01:54,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-10-01 16:01:54,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportWithTargetName 2023-10-01 16:01:54,741 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=755 (was 708) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/cluster_dc626531-59bc-a717-57a6-1c05e4c967d9/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:34295 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:34389 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/cluster_dc626531-59bc-a717-57a6-1c05e4c967d9/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:36093 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/cluster_dc626531-59bc-a717-57a6-1c05e4c967d9/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/cluster_dc626531-59bc-a717-57a6-1c05e4c967d9/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1904937204_1 at /127.0.0.1:51078 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1904937204_1 at /127.0.0.1:42690 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1478872176_17 at /127.0.0.1:56022 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4c068432-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1478872176_17 at /127.0.0.1:51098 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4c068432-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4c068432-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/cluster_dc626531-59bc-a717-57a6-1c05e4c967d9/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1478872176_17 at /127.0.0.1:42718 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/cluster_dc626531-59bc-a717-57a6-1c05e4c967d9/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4c068432-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=925 (was 897) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=202 (was 163) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=1699 (was 2492) 2023-10-01 16:01:54,742 WARN [Listener at jenkins-hbase4.apache.org/36093] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-10-01 16:01:54,764 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=925, MaxFileDescriptor=60000, SystemLoadAverage=202, ProcessCount=168, AvailableMemoryMB=1698 2023-10-01 16:01:54,764 WARN [Listener at jenkins-hbase4.apache.org/36093] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-10-01 16:01:54,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 16:01:54,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-10-01 16:01:54,773 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 16:01:54,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-10-01 16:01:54,776 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 16:01:54,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-01 16:01:54,780 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemState/f7e366a98025b56dca5bb2c9e19a2175 2023-10-01 16:01:54,780 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemState/36c63f5db10365ecad7ff662f507b28a 2023-10-01 16:01:54,781 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemState/f7e366a98025b56dca5bb2c9e19a2175 empty. 2023-10-01 16:01:54,781 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemState/36c63f5db10365ecad7ff662f507b28a empty. 2023-10-01 16:01:54,781 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemState/f7e366a98025b56dca5bb2c9e19a2175 2023-10-01 16:01:54,781 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemState/36c63f5db10365ecad7ff662f507b28a 2023-10-01 16:01:54,781 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-01 16:01:54,801 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-01 16:01:54,802 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => f7e366a98025b56dca5bb2c9e19a2175, NAME => 'testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp 2023-10-01 16:01:54,803 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 36c63f5db10365ecad7ff662f507b28a, NAME => 'testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp 2023-10-01 16:01:54,831 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:01:54,832 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing f7e366a98025b56dca5bb2c9e19a2175, disabling compactions & flushes 2023-10-01 16:01:54,832 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175. 2023-10-01 16:01:54,832 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175. 2023-10-01 16:01:54,832 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175. after waiting 0 ms 2023-10-01 16:01:54,832 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175. 2023-10-01 16:01:54,832 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175. 2023-10-01 16:01:54,832 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for f7e366a98025b56dca5bb2c9e19a2175: 2023-10-01 16:01:54,833 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:01:54,834 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 36c63f5db10365ecad7ff662f507b28a, disabling compactions & flushes 2023-10-01 16:01:54,834 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a. 2023-10-01 16:01:54,834 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a. 2023-10-01 16:01:54,834 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a. after waiting 0 ms 2023-10-01 16:01:54,834 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a. 2023-10-01 16:01:54,835 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a. 2023-10-01 16:01:54,835 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 36c63f5db10365ecad7ff662f507b28a: 2023-10-01 16:01:54,838 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 16:01:54,840 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696176114839"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176114839"}]},"ts":"1696176114839"} 2023-10-01 16:01:54,840 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696176114839"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176114839"}]},"ts":"1696176114839"} 2023-10-01 16:01:54,843 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 16:01:54,844 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 16:01:54,844 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176114844"}]},"ts":"1696176114844"} 2023-10-01 16:01:54,849 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-10-01 16:01:54,858 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 16:01:54,860 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 16:01:54,860 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 16:01:54,860 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 16:01:54,860 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 16:01:54,860 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f7e366a98025b56dca5bb2c9e19a2175, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=36c63f5db10365ecad7ff662f507b28a, ASSIGN}] 2023-10-01 16:01:54,863 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=36c63f5db10365ecad7ff662f507b28a, ASSIGN 2023-10-01 16:01:54,864 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f7e366a98025b56dca5bb2c9e19a2175, ASSIGN 2023-10-01 16:01:54,865 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=36c63f5db10365ecad7ff662f507b28a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45599,1696176089006; forceNewPlan=false, retain=false 2023-10-01 16:01:54,865 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f7e366a98025b56dca5bb2c9e19a2175, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38419,1696176088917; forceNewPlan=false, retain=false 2023-10-01 16:01:54,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-01 16:01:55,015 INFO [jenkins-hbase4:42819] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 16:01:55,018 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=36c63f5db10365ecad7ff662f507b28a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:55,018 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=f7e366a98025b56dca5bb2c9e19a2175, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:55,018 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696176115018"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176115018"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176115018"}]},"ts":"1696176115018"} 2023-10-01 16:01:55,018 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696176115018"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176115018"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176115018"}]},"ts":"1696176115018"} 2023-10-01 16:01:55,021 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 36c63f5db10365ecad7ff662f507b28a, server=jenkins-hbase4.apache.org,45599,1696176089006}] 2023-10-01 16:01:55,022 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure f7e366a98025b56dca5bb2c9e19a2175, server=jenkins-hbase4.apache.org,38419,1696176088917}] 2023-10-01 16:01:55,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-01 16:01:55,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a. 2023-10-01 16:01:55,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 36c63f5db10365ecad7ff662f507b28a, NAME => 'testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 16:01:55,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a. service=AccessControlService 2023-10-01 16:01:55,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175. 2023-10-01 16:01:55,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 16:01:55,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f7e366a98025b56dca5bb2c9e19a2175, NAME => 'testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 16:01:55,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 36c63f5db10365ecad7ff662f507b28a 2023-10-01 16:01:55,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:01:55,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 36c63f5db10365ecad7ff662f507b28a 2023-10-01 16:01:55,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 36c63f5db10365ecad7ff662f507b28a 2023-10-01 16:01:55,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175. service=AccessControlService 2023-10-01 16:01:55,184 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 16:01:55,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState f7e366a98025b56dca5bb2c9e19a2175 2023-10-01 16:01:55,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:01:55,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f7e366a98025b56dca5bb2c9e19a2175 2023-10-01 16:01:55,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f7e366a98025b56dca5bb2c9e19a2175 2023-10-01 16:01:55,185 INFO [StoreOpener-36c63f5db10365ecad7ff662f507b28a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 36c63f5db10365ecad7ff662f507b28a 2023-10-01 16:01:55,186 INFO [StoreOpener-f7e366a98025b56dca5bb2c9e19a2175-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f7e366a98025b56dca5bb2c9e19a2175 2023-10-01 16:01:55,187 DEBUG [StoreOpener-36c63f5db10365ecad7ff662f507b28a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemState/36c63f5db10365ecad7ff662f507b28a/cf 2023-10-01 16:01:55,187 DEBUG [StoreOpener-36c63f5db10365ecad7ff662f507b28a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemState/36c63f5db10365ecad7ff662f507b28a/cf 2023-10-01 16:01:55,187 INFO [StoreOpener-36c63f5db10365ecad7ff662f507b28a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36c63f5db10365ecad7ff662f507b28a columnFamilyName cf 2023-10-01 16:01:55,187 DEBUG [StoreOpener-f7e366a98025b56dca5bb2c9e19a2175-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemState/f7e366a98025b56dca5bb2c9e19a2175/cf 2023-10-01 16:01:55,188 DEBUG [StoreOpener-f7e366a98025b56dca5bb2c9e19a2175-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemState/f7e366a98025b56dca5bb2c9e19a2175/cf 2023-10-01 16:01:55,188 INFO [StoreOpener-f7e366a98025b56dca5bb2c9e19a2175-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f7e366a98025b56dca5bb2c9e19a2175 columnFamilyName cf 2023-10-01 16:01:55,189 INFO [StoreOpener-36c63f5db10365ecad7ff662f507b28a-1] regionserver.HStore(310): Store=36c63f5db10365ecad7ff662f507b28a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 16:01:55,190 INFO [StoreOpener-f7e366a98025b56dca5bb2c9e19a2175-1] regionserver.HStore(310): Store=f7e366a98025b56dca5bb2c9e19a2175/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 16:01:55,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemState/36c63f5db10365ecad7ff662f507b28a 2023-10-01 16:01:55,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemState/f7e366a98025b56dca5bb2c9e19a2175 2023-10-01 16:01:55,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemState/36c63f5db10365ecad7ff662f507b28a 2023-10-01 16:01:55,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemState/f7e366a98025b56dca5bb2c9e19a2175 2023-10-01 16:01:55,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 36c63f5db10365ecad7ff662f507b28a 2023-10-01 16:01:55,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f7e366a98025b56dca5bb2c9e19a2175 2023-10-01 16:01:55,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemState/36c63f5db10365ecad7ff662f507b28a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 16:01:55,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemState/f7e366a98025b56dca5bb2c9e19a2175/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 16:01:55,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 36c63f5db10365ecad7ff662f507b28a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73352822, jitterRate=0.09304222464561462}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 16:01:55,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f7e366a98025b56dca5bb2c9e19a2175; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69141039, jitterRate=0.03028176724910736}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 16:01:55,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 36c63f5db10365ecad7ff662f507b28a: 2023-10-01 16:01:55,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f7e366a98025b56dca5bb2c9e19a2175: 2023-10-01 16:01:55,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a., pid=30, masterSystemTime=1696176115173 2023-10-01 16:01:55,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175., pid=31, masterSystemTime=1696176115174 2023-10-01 16:01:55,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a. 2023-10-01 16:01:55,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a. 2023-10-01 16:01:55,203 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=36c63f5db10365ecad7ff662f507b28a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:55,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175. 2023-10-01 16:01:55,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175. 2023-10-01 16:01:55,203 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696176115203"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696176115203"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696176115203"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696176115203"}]},"ts":"1696176115203"} 2023-10-01 16:01:55,204 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=f7e366a98025b56dca5bb2c9e19a2175, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:55,204 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696176115204"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696176115204"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696176115204"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696176115204"}]},"ts":"1696176115204"} 2023-10-01 16:01:55,211 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-10-01 16:01:55,212 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 36c63f5db10365ecad7ff662f507b28a, server=jenkins-hbase4.apache.org,45599,1696176089006 in 187 msec 2023-10-01 16:01:55,214 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-10-01 16:01:55,217 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure f7e366a98025b56dca5bb2c9e19a2175, server=jenkins-hbase4.apache.org,38419,1696176088917 in 187 msec 2023-10-01 16:01:55,218 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=36c63f5db10365ecad7ff662f507b28a, ASSIGN in 352 msec 2023-10-01 16:01:55,220 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-10-01 16:01:55,220 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f7e366a98025b56dca5bb2c9e19a2175, ASSIGN in 357 msec 2023-10-01 16:01:55,221 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 16:01:55,221 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176115221"}]},"ts":"1696176115221"} 2023-10-01 16:01:55,222 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-10-01 16:01:55,225 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 16:01:55,225 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-10-01 16:01:55,228 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37191] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 16:01:55,229 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:01:55,229 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:01:55,229 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:01:55,229 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:01:55,231 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 16:01:55,231 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 16:01:55,231 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 16:01:55,231 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 16:01:55,232 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 462 msec 2023-10-01 16:01:55,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-01 16:01:55,381 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-10-01 16:01:55,384 DEBUG [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-01 16:01:55,384 DEBUG [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175. 2023-10-01 16:01:55,387 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 16:01:55,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 16:01:55,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696176115401 (current time:1696176115401). 2023-10-01 16:01:55,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 16:01:55,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x691c1ce3 to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:01:55,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@257ab76b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:01:55,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:01:55,413 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37420, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:01:55,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x691c1ce3 to 127.0.0.1:60886 2023-10-01 16:01:55,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:01:55,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x239de4c1 to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:01:55,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2aef1f55, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:01:55,423 DEBUG [hconnection-0x5ade248c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:01:55,427 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37424, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:01:55,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:01:55,432 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46926, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:01:55,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x239de4c1 to 127.0.0.1:60886 2023-10-01 16:01:55,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:01:55,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 16:01:55,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 16:01:55,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 16:01:55,439 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot, current working dir path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 16:01:55,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 16:01:55,442 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 16:01:55,443 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696176715443 2023-10-01 16:01:55,443 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-01 16:01:55,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 16:01:55,445 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 16:01:55,445 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 16:01:55,446 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 16:01:55,447 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 16:01:55,449 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-10-01 16:01:55,450 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 16:01:55,451 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696176715451 2023-10-01 16:01:55,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,482 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-10-01 16:01:55,482 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:01:55,483 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-10-01 16:01:55,483 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-01 16:01:55,484 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,484 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,486 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:01:55,487 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:01:55,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:01:55,486 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:01:55,487 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:55,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:01:55,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:01:55,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:01:55,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:01:55,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:01:55,487 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:55,487 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:55,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,488 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:55,488 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 16:01:55,488 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,488 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,488 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-01 16:01:55,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-01 16:01:55,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-01 16:01:55,489 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 16:01:55,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,489 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 16:01:55,489 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 16:01:55,489 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,489 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,489 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 16:01:55,489 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:01:55,489 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 16:01:55,489 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:01:55,491 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 16:01:55,491 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,492 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-01 16:01:55,492 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 16:01:55,492 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 16:01:55,492 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:01:55,492 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37191,1696176088973' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-01 16:01:55,493 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 16:01:55,492 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-01 16:01:55,494 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45599,1696176089006' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-01 16:01:55,494 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-01 16:01:55,494 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38419,1696176088917' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-01 16:01:55,495 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,502 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:55,502 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,502 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:55,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:01:55,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:01:55,502 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,502 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,502 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:01:55,502 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:55,502 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:01:55,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:01:55,502 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,502 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:01:55,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:01:55,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:55,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:55,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:55,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:01:55,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45599,1696176089006' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-01 16:01:55,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@115cf33e[Count = 1] remaining members to acquire global barrier 2023-10-01 16:01:55,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:55,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:01:55,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:01:55,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:01:55,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:01:55,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:55,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:55,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:55,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:01:55,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38419,1696176088917' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-01 16:01:55,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@115cf33e[Count = 0] remaining members to acquire global barrier 2023-10-01 16:01:55,507 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-01 16:01:55,507 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,508 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,508 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,508 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,509 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 16:01:55,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,509 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:55,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,509 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 16:01:55,509 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-01 16:01:55,509 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37191,1696176088973' in zk 2023-10-01 16:01:55,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,509 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 16:01:55,509 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:55,509 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 16:01:55,511 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 16:01:55,511 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:01:55,511 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-01 16:01:55,515 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 16:01:55,517 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a. 2023-10-01 16:01:55,517 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 16:01:55,517 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a. started... 2023-10-01 16:01:55,517 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 16:01:55,517 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 16:01:55,519 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 36c63f5db10365ecad7ff662f507b28a: 2023-10-01 16:01:55,518 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175. 2023-10-01 16:01:55,519 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175. started... 2023-10-01 16:01:55,519 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,519 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f7e366a98025b56dca5bb2c9e19a2175: 2023-10-01 16:01:55,519 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 16:01:55,519 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 16:01:55,519 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,519 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 16:01:55,519 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 16:01:55,545 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 16:01:55,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 16:01:55,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-01 16:01:55,547 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 16:01:55,747 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 16:01:55,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 16:01:55,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-01 16:01:55,748 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-01 16:01:55,954 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175. completed. 2023-10-01 16:01:55,954 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a. completed. 2023-10-01 16:01:55,954 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175. 2023-10-01 16:01:55,954 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a. 2023-10-01 16:01:55,955 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 16:01:55,955 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 16:01:55,955 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:55,955 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 16:01:55,955 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 16:01:55,955 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:55,955 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-01 16:01:55,955 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-01 16:01:55,955 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38419,1696176088917' in zk 2023-10-01 16:01:55,955 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45599,1696176089006' in zk 2023-10-01 16:01:55,958 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:55,958 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 16:01:55,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:55,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:01:55,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:01:55,958 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:01:55,958 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:55,958 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 16:01:55,960 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:01:55,958 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-01 16:01:55,960 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-01 16:01:55,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:01:55,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:01:55,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:55,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:55,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:55,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:01:55,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:55,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:55,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:55,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45599,1696176089006': 2023-10-01 16:01:55,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45599,1696176089006' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-01 16:01:55,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:55,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:01:55,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:01:55,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:01:55,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:01:55,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:55,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:55,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:55,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:01:55,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:55,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:55,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:55,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,38419,1696176088917': 2023-10-01 16:01:55,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38419,1696176088917' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-01 16:01:55,968 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-10-01 16:01:55,968 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 16:01:55,968 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 16:01:55,968 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,968 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 16:01:55,970 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,970 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,970 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,970 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:01:55,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,970 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:01:55,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,970 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:01:55,970 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:01:55,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:01:55,971 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:55,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:01:55,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:01:55,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:01:55,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:01:55,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:01:55,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:01:55,971 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:55,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:01:55,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,972 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:55,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:01:55,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:55,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:55,974 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:55,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:55,974 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:55,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:01:55,975 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:55,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:55,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:55,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:55,978 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:55,978 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:01:55,978 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:01:55,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:01:55,978 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:01:55,978 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:01:55,978 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:01:55,978 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:55,979 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,979 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:55,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:01:55,978 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:01:55,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:01:55,978 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:01:55,978 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:01:55,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:01:55,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:01:55,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:01:55,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:01:55,979 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,979 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-01 16:01:55,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:01:55,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 16:01:55,981 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:55,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:01:55,981 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:01:55,981 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:55,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:01:55,982 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:55,982 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,982 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,982 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 16:01:55,991 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:55,991 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:56,011 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:56,012 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-01 16:01:56,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:56,013 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-01 16:01:56,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696176115443Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696176115991 (+548 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1696176115991Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1696176115991Writing data manifest for emptySnaptb0-testExportFileSystemState at 1696176115994 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1696176116004 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696176116012 (+8 ms) 2023-10-01 16:01:56,015 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 16:01:56,018 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 570 msec 2023-10-01 16:01:56,048 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 16:01:56,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 16:01:56,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 16:01:56,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38419] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 16:01:56,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45599] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 16:01:56,062 DEBUG [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-01 16:01:56,062 DEBUG [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175. 2023-10-01 16:01:56,062 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 16:01:56,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 16:01:56,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696176116075 (current time:1696176116075). 2023-10-01 16:01:56,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 16:01:56,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x660246cd to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:01:56,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6961c33e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:01:56,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:01:56,089 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37436, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:01:56,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x660246cd to 127.0.0.1:60886 2023-10-01 16:01:56,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:01:56,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x520a742a to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:01:56,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41d52b4c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:01:56,098 DEBUG [hconnection-0xad876ad-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:01:56,099 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37446, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:01:56,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:01:56,107 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46930, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:01:56,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x520a742a to 127.0.0.1:60886 2023-10-01 16:01:56,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:01:56,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 16:01:56,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 16:01:56,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 16:01:56,113 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot, current working dir path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 16:01:56,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 16:01:56,116 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 16:01:56,117 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696176716117 2023-10-01 16:01:56,117 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-01 16:01:56,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 16:01:56,120 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 16:01:56,120 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 16:01:56,121 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 16:01:56,122 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 16:01:56,124 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-10-01 16:01:56,126 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 16:01:56,127 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696176716127 2023-10-01 16:01:56,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-10-01 16:01:56,144 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-10-01 16:01:56,144 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:01:56,145 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-10-01 16:01:56,146 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-01 16:01:56,146 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,146 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,147 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:01:56,147 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:01:56,148 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:56,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:01:56,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:01:56,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:01:56,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:01:56,147 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:01:56,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:01:56,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:01:56,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,148 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:56,148 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:56,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,149 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:56,149 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 16:01:56,149 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-01 16:01:56,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,149 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-01 16:01:56,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-01 16:01:56,149 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 16:01:56,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,149 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 16:01:56,150 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 16:01:56,150 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-01 16:01:56,150 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-01 16:01:56,150 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 16:01:56,150 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 16:01:56,150 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-01 16:01:56,150 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:01:56,150 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:01:56,151 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 16:01:56,153 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 16:01:56,153 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-01 16:01:56,150 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 16:01:56,153 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38419,1696176088917' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-01 16:01:56,153 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-01 16:01:56,153 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45599,1696176089006' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-01 16:01:56,153 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:01:56,154 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 16:01:56,154 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-01 16:01:56,154 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37191,1696176088973' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-01 16:01:56,157 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:56,157 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:56,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:01:56,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:01:56,158 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,158 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,158 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:01:56,158 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:01:56,158 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:56,159 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:01:56,159 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:01:56,159 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,159 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:01:56,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 16:01:56,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:56,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:56,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:56,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:01:56,161 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38419,1696176088917' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-01 16:01:56,161 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@474c0dae[Count = 1] remaining members to acquire global barrier 2023-10-01 16:01:56,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:56,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:01:56,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:01:56,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:01:56,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:01:56,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 16:01:56,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:56,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:56,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:56,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:01:56,164 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45599,1696176089006' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-01 16:01:56,164 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@474c0dae[Count = 0] remaining members to acquire global barrier 2023-10-01 16:01:56,164 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-01 16:01:56,164 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,165 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,165 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,165 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,165 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 16:01:56,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,165 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:56,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,166 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 16:01:56,166 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 16:01:56,166 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-01 16:01:56,166 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37191,1696176088973' in zk 2023-10-01 16:01:56,166 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 16:01:56,166 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:56,166 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 16:01:56,166 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175. 2023-10-01 16:01:56,166 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 16:01:56,166 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 16:01:56,166 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175. started... 2023-10-01 16:01:56,166 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 16:01:56,166 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a. 2023-10-01 16:01:56,167 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a. started... 2023-10-01 16:01:56,167 INFO [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f7e366a98025b56dca5bb2c9e19a2175 1/1 column families, dataSize=132 B heapSize=544 B 2023-10-01 16:01:56,167 INFO [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 36c63f5db10365ecad7ff662f507b28a 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-10-01 16:01:56,167 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 16:01:56,167 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:01:56,167 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-01 16:01:56,199 INFO [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310019c749c073b82480badfa17d730e60ed3 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310019c749c073b82480badfa17d730e60ed3 2023-10-01 16:01:56,209 INFO [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231001e39f5f5105f1475a903a41eb18765e7d to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231001e39f5f5105f1475a903a41eb18765e7d 2023-10-01 16:01:56,220 INFO [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemState/f7e366a98025b56dca5bb2c9e19a2175/.tmp/cf/7d923f003dfa4410960eb734c22fb512 2023-10-01 16:01:56,220 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 16:01:56,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 16:01:56,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-01 16:01:56,222 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 16:01:56,225 INFO [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemState/36c63f5db10365ecad7ff662f507b28a/.tmp/cf/ea0eb08d2fe34aa9bdb60403f309f495 2023-10-01 16:01:56,227 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemState/f7e366a98025b56dca5bb2c9e19a2175/.tmp/cf/7d923f003dfa4410960eb734c22fb512 as hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemState/f7e366a98025b56dca5bb2c9e19a2175/cf/7d923f003dfa4410960eb734c22fb512 2023-10-01 16:01:56,233 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemState/36c63f5db10365ecad7ff662f507b28a/.tmp/cf/ea0eb08d2fe34aa9bdb60403f309f495 as hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemState/36c63f5db10365ecad7ff662f507b28a/cf/ea0eb08d2fe34aa9bdb60403f309f495 2023-10-01 16:01:56,233 INFO [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemState/f7e366a98025b56dca5bb2c9e19a2175/cf/7d923f003dfa4410960eb734c22fb512, entries=2, sequenceid=6, filesize=5.2 K 2023-10-01 16:01:56,235 INFO [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for f7e366a98025b56dca5bb2c9e19a2175 in 68ms, sequenceid=6, compaction requested=false 2023-10-01 16:01:56,235 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-10-01 16:01:56,236 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f7e366a98025b56dca5bb2c9e19a2175: 2023-10-01 16:01:56,236 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-01 16:01:56,236 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 16:01:56,236 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemState/f7e366a98025b56dca5bb2c9e19a2175/cf/7d923f003dfa4410960eb734c22fb512] hfiles 2023-10-01 16:01:56,236 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemState/f7e366a98025b56dca5bb2c9e19a2175/cf/7d923f003dfa4410960eb734c22fb512 for snapshot=snaptb0-testExportFileSystemState 2023-10-01 16:01:56,239 INFO [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemState/36c63f5db10365ecad7ff662f507b28a/cf/ea0eb08d2fe34aa9bdb60403f309f495, entries=48, sequenceid=6, filesize=13.0 K 2023-10-01 16:01:56,240 INFO [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 36c63f5db10365ecad7ff662f507b28a in 73ms, sequenceid=6, compaction requested=false 2023-10-01 16:01:56,242 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 36c63f5db10365ecad7ff662f507b28a: 2023-10-01 16:01:56,242 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-01 16:01:56,242 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 16:01:56,242 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemState/36c63f5db10365ecad7ff662f507b28a/cf/ea0eb08d2fe34aa9bdb60403f309f495] hfiles 2023-10-01 16:01:56,242 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemState/36c63f5db10365ecad7ff662f507b28a/cf/ea0eb08d2fe34aa9bdb60403f309f495 for snapshot=snaptb0-testExportFileSystemState 2023-10-01 16:01:56,258 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175. completed. 2023-10-01 16:01:56,258 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175. 2023-10-01 16:01:56,258 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 16:01:56,258 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 16:01:56,258 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:56,258 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-01 16:01:56,258 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38419,1696176088917' in zk 2023-10-01 16:01:56,263 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a. completed. 2023-10-01 16:01:56,263 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a. 2023-10-01 16:01:56,263 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 16:01:56,263 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 16:01:56,263 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:56,263 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-01 16:01:56,263 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45599,1696176089006' in zk 2023-10-01 16:01:56,264 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 16:01:56,264 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:56,264 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:01:56,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:56,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:01:56,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:01:56,264 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-01 16:01:56,266 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 16:01:56,267 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:56,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:01:56,267 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:01:56,267 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-01 16:01:56,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:01:56,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 16:01:56,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:56,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:56,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:56,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:01:56,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 16:01:56,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:56,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:56,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:56,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,38419,1696176088917': 2023-10-01 16:01:56,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38419,1696176088917' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-01 16:01:56,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:56,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:01:56,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:01:56,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:01:56,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:01:56,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 16:01:56,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:56,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:56,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:56,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:01:56,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 16:01:56,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:56,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:56,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:56,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45599,1696176089006': 2023-10-01 16:01:56,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45599,1696176089006' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-01 16:01:56,275 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-10-01 16:01:56,275 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 16:01:56,275 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 16:01:56,275 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-10-01 16:01:56,275 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 16:01:56,277 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,277 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,277 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:01:56,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:01:56,277 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:01:56,277 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,277 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:01:56,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,278 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:01:56,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,278 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:56,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:01:56,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:01:56,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:01:56,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:01:56,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:01:56,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:01:56,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:01:56,278 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:56,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 16:01:56,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:01:56,279 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:56,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 16:01:56,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:56,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:56,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:56,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:01:56,281 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:56,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 16:01:56,281 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:56,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:56,282 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:56,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:56,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:56,286 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:56,286 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,286 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:56,286 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:01:56,286 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:56,286 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-10-01 16:01:56,286 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:01:56,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:01:56,286 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,286 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:01:56,286 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:01:56,287 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:01:56,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:01:56,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:01:56,287 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:01:56,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:01:56,286 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-01 16:01:56,289 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,289 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-01 16:01:56,289 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:01:56,289 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 16:01:56,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:01:56,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:01:56,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:01:56,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:01:56,289 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:01:56,289 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:01:56,290 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:01:56,290 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,290 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:01:56,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:01:56,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:01:56,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:01:56,290 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231001e39f5f5105f1475a903a41eb18765e7d, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310019c749c073b82480badfa17d730e60ed3] mob files 2023-10-01 16:01:56,290 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231001e39f5f5105f1475a903a41eb18765e7d 2023-10-01 16:01:56,291 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310019c749c073b82480badfa17d730e60ed3 2023-10-01 16:01:56,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-10-01 16:01:56,303 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,335 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,335 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-01 16:01:56,335 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,336 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,336 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696176116117Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696176116302 (+185 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1696176116302Loading Region manifests for snaptb0-testExportFileSystemState at 1696176116302Writing data manifest for snaptb0-testExportFileSystemState at 1696176116311 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1696176116325 (+14 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696176116335 (+10 ms) 2023-10-01 16:01:56,339 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 16:01:56,341 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 220 msec 2023-10-01 16:01:56,422 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 16:01:56,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 16:01:56,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 16:01:56,424 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176116424 2023-10-01 16:01:56,424 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44103, tgtDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176116424, rawTgtDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176116424, srcFsUri=hdfs://localhost:44103, srcDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc 2023-10-01 16:01:56,450 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44103, inputRoot=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc 2023-10-01 16:01:56,450 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_43978870_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176116424, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176116424/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,450 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44103, inputRoot=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc, snapshotDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-10-01 16:01:56,466 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176116424/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-01 16:01:56,490 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 16:01:56,490 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 16:01:56,491 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 16:01:56,491 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 16:01:57,384 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/hadoop-8543942231628781117.jar 2023-10-01 16:01:57,385 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 16:01:57,385 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 16:01:57,452 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/hadoop-4229683371628018665.jar 2023-10-01 16:01:57,453 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 16:01:57,453 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 16:01:57,454 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 16:01:57,454 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 16:01:57,454 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 16:01:57,455 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 16:01:57,455 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 16:01:57,456 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 16:01:57,456 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 16:01:57,456 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 16:01:57,457 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 16:01:57,457 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 16:01:57,458 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 16:01:57,458 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 16:01:57,458 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 16:01:57,459 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 16:01:57,460 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:01:57,460 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:01:57,461 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 16:01:57,461 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:01:57,461 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:01:57,462 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 16:01:57,462 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 16:01:58,348 WARN [Listener at jenkins-hbase4.apache.org/36093] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 16:01:58,351 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-10-01 16:01:58,353 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-01 16:01:58,868 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 16:01:58,868 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 16:01:58,875 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0001_000001 (auth:SIMPLE) 2023-10-01 16:01:59,580 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0002_000001 (auth:SIMPLE) 2023-10-01 16:01:59,998 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 16:02:03,564 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0002_000001 (auth:SIMPLE) 2023-10-01 16:02:05,791 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0002_000001 (auth:SIMPLE) 2023-10-01 16:02:08,921 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0002_000001 (auth:SIMPLE) 2023-10-01 16:02:10,541 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 16:02:10,542 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 16:02:10,550 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-10-01 16:02:10,550 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 16:02:10,551 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 16:02:10,551 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1478872176_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-01 16:02:10,551 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-01 16:02:10,551 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-01 16:02:10,551 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1478872176_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176116424/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176116424/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-01 16:02:10,552 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176116424/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-01 16:02:10,552 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176116424/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-01 16:02:10,559 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-10-01 16:02:10,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-10-01 16:02:10,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-10-01 16:02:10,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-01 16:02:10,564 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176130564"}]},"ts":"1696176130564"} 2023-10-01 16:02:10,566 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-10-01 16:02:10,567 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-10-01 16:02:10,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f7e366a98025b56dca5bb2c9e19a2175, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=36c63f5db10365ecad7ff662f507b28a, UNASSIGN}] 2023-10-01 16:02:10,571 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=36c63f5db10365ecad7ff662f507b28a, UNASSIGN 2023-10-01 16:02:10,571 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f7e366a98025b56dca5bb2c9e19a2175, UNASSIGN 2023-10-01 16:02:10,572 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=36c63f5db10365ecad7ff662f507b28a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:10,572 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696176130571"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176130571"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176130571"}]},"ts":"1696176130571"} 2023-10-01 16:02:10,572 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=f7e366a98025b56dca5bb2c9e19a2175, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:10,573 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696176130572"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176130572"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176130572"}]},"ts":"1696176130572"} 2023-10-01 16:02:10,575 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 36c63f5db10365ecad7ff662f507b28a, server=jenkins-hbase4.apache.org,45599,1696176089006}] 2023-10-01 16:02:10,576 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure f7e366a98025b56dca5bb2c9e19a2175, server=jenkins-hbase4.apache.org,38419,1696176088917}] 2023-10-01 16:02:10,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-01 16:02:10,728 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 36c63f5db10365ecad7ff662f507b28a 2023-10-01 16:02:10,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 36c63f5db10365ecad7ff662f507b28a, disabling compactions & flushes 2023-10-01 16:02:10,729 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f7e366a98025b56dca5bb2c9e19a2175 2023-10-01 16:02:10,729 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a. 2023-10-01 16:02:10,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a. 2023-10-01 16:02:10,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a. after waiting 0 ms 2023-10-01 16:02:10,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a. 2023-10-01 16:02:10,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f7e366a98025b56dca5bb2c9e19a2175, disabling compactions & flushes 2023-10-01 16:02:10,729 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175. 2023-10-01 16:02:10,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175. 2023-10-01 16:02:10,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175. after waiting 0 ms 2023-10-01 16:02:10,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175. 2023-10-01 16:02:10,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemState/36c63f5db10365ecad7ff662f507b28a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 16:02:10,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemState/f7e366a98025b56dca5bb2c9e19a2175/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 16:02:10,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 16:02:10,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a. 2023-10-01 16:02:10,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 36c63f5db10365ecad7ff662f507b28a: 2023-10-01 16:02:10,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 16:02:10,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175. 2023-10-01 16:02:10,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f7e366a98025b56dca5bb2c9e19a2175: 2023-10-01 16:02:10,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 36c63f5db10365ecad7ff662f507b28a 2023-10-01 16:02:10,749 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=36c63f5db10365ecad7ff662f507b28a, regionState=CLOSED 2023-10-01 16:02:10,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f7e366a98025b56dca5bb2c9e19a2175 2023-10-01 16:02:10,749 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696176130749"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176130749"}]},"ts":"1696176130749"} 2023-10-01 16:02:10,750 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=f7e366a98025b56dca5bb2c9e19a2175, regionState=CLOSED 2023-10-01 16:02:10,750 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696176130750"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176130750"}]},"ts":"1696176130750"} 2023-10-01 16:02:10,754 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=38 2023-10-01 16:02:10,754 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 36c63f5db10365ecad7ff662f507b28a, server=jenkins-hbase4.apache.org,45599,1696176089006 in 176 msec 2023-10-01 16:02:10,754 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=37 2023-10-01 16:02:10,754 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure f7e366a98025b56dca5bb2c9e19a2175, server=jenkins-hbase4.apache.org,38419,1696176088917 in 176 msec 2023-10-01 16:02:10,755 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=36c63f5db10365ecad7ff662f507b28a, UNASSIGN in 186 msec 2023-10-01 16:02:10,756 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-10-01 16:02:10,756 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f7e366a98025b56dca5bb2c9e19a2175, UNASSIGN in 186 msec 2023-10-01 16:02:10,757 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176130757"}]},"ts":"1696176130757"} 2023-10-01 16:02:10,758 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-10-01 16:02:10,760 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-10-01 16:02:10,762 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 202 msec 2023-10-01 16:02:10,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-01 16:02:10,867 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-10-01 16:02:10,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-10-01 16:02:10,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 16:02:10,871 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 16:02:10,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-10-01 16:02:10,872 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 16:02:10,874 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37191] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-10-01 16:02:10,877 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 16:02:10,877 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 16:02:10,877 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 16:02:10,878 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 16:02:10,878 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemState/f7e366a98025b56dca5bb2c9e19a2175 2023-10-01 16:02:10,878 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-01 16:02:10,878 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-01 16:02:10,878 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemState/36c63f5db10365ecad7ff662f507b28a 2023-10-01 16:02:10,878 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-01 16:02:10,878 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-01 16:02:10,880 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 16:02:10,880 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 16:02:10,880 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:10,880 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:10,880 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 16:02:10,880 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 16:02:10,880 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:10,880 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:10,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-01 16:02:10,881 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemState/f7e366a98025b56dca5bb2c9e19a2175/cf, FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemState/f7e366a98025b56dca5bb2c9e19a2175/recovered.edits] 2023-10-01 16:02:10,882 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemState/36c63f5db10365ecad7ff662f507b28a/cf, FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemState/36c63f5db10365ecad7ff662f507b28a/recovered.edits] 2023-10-01 16:02:10,887 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemState/f7e366a98025b56dca5bb2c9e19a2175/cf/7d923f003dfa4410960eb734c22fb512 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportFileSystemState/f7e366a98025b56dca5bb2c9e19a2175/cf/7d923f003dfa4410960eb734c22fb512 2023-10-01 16:02:10,888 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemState/36c63f5db10365ecad7ff662f507b28a/cf/ea0eb08d2fe34aa9bdb60403f309f495 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportFileSystemState/36c63f5db10365ecad7ff662f507b28a/cf/ea0eb08d2fe34aa9bdb60403f309f495 2023-10-01 16:02:10,891 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemState/f7e366a98025b56dca5bb2c9e19a2175/recovered.edits/9.seqid to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportFileSystemState/f7e366a98025b56dca5bb2c9e19a2175/recovered.edits/9.seqid 2023-10-01 16:02:10,891 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemState/36c63f5db10365ecad7ff662f507b28a/recovered.edits/9.seqid to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportFileSystemState/36c63f5db10365ecad7ff662f507b28a/recovered.edits/9.seqid 2023-10-01 16:02:10,892 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemState/f7e366a98025b56dca5bb2c9e19a2175 2023-10-01 16:02:10,892 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemState/36c63f5db10365ecad7ff662f507b28a 2023-10-01 16:02:10,892 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-01 16:02:10,893 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-01 16:02:10,894 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-10-01 16:02:10,898 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231001e39f5f5105f1475a903a41eb18765e7d to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231001e39f5f5105f1475a903a41eb18765e7d 2023-10-01 16:02:10,899 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310019c749c073b82480badfa17d730e60ed3 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310019c749c073b82480badfa17d730e60ed3 2023-10-01 16:02:10,900 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-01 16:02:10,903 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 16:02:10,905 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-10-01 16:02:10,908 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-10-01 16:02:10,909 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 16:02:10,910 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-10-01 16:02:10,910 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696176130910"}]},"ts":"9223372036854775807"} 2023-10-01 16:02:10,910 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696176130910"}]},"ts":"9223372036854775807"} 2023-10-01 16:02:10,912 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 16:02:10,912 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f7e366a98025b56dca5bb2c9e19a2175, NAME => 'testtb-testExportFileSystemState,,1696176114766.f7e366a98025b56dca5bb2c9e19a2175.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 36c63f5db10365ecad7ff662f507b28a, NAME => 'testtb-testExportFileSystemState,1,1696176114766.36c63f5db10365ecad7ff662f507b28a.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 16:02:10,912 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-10-01 16:02:10,912 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696176130912"}]},"ts":"9223372036854775807"} 2023-10-01 16:02:10,914 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-10-01 16:02:10,917 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 16:02:10,918 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 49 msec 2023-10-01 16:02:10,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-01 16:02:10,983 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-10-01 16:02:10,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-10-01 16:02:10,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-10-01 16:02:10,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-10-01 16:02:10,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemState 2023-10-01 16:02:11,024 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=765 (was 755) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1478872176_17 at /127.0.0.1:35062 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4c068432-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1478872176_17 at /127.0.0.1:53902 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-123029727_1 at /127.0.0.1:60132 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4c068432-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1963 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-123029727_1 at /127.0.0.1:35044 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1478872176_17 at /127.0.0.1:60164 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:40803 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4c068432-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4c068432-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:37119 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=934 (was 925) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=172 (was 202), ProcessCount=168 (was 168), AvailableMemoryMB=1536 (was 1698) 2023-10-01 16:02:11,025 WARN [Listener at jenkins-hbase4.apache.org/36093] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-01 16:02:11,046 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=934, MaxFileDescriptor=60000, SystemLoadAverage=172, ProcessCount=168, AvailableMemoryMB=1535 2023-10-01 16:02:11,047 WARN [Listener at jenkins-hbase4.apache.org/36093] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-01 16:02:11,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 16:02:11,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-10-01 16:02:11,052 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 16:02:11,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-10-01 16:02:11,053 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 16:02:11,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-01 16:02:11,056 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testConsecutiveExports/630aa248a3950404422299d067525477 2023-10-01 16:02:11,056 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testConsecutiveExports/728e85f5dd053e86e59e7dfb0445ea36 2023-10-01 16:02:11,056 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testConsecutiveExports/630aa248a3950404422299d067525477 empty. 2023-10-01 16:02:11,056 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testConsecutiveExports/728e85f5dd053e86e59e7dfb0445ea36 empty. 2023-10-01 16:02:11,057 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testConsecutiveExports/630aa248a3950404422299d067525477 2023-10-01 16:02:11,057 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testConsecutiveExports/728e85f5dd053e86e59e7dfb0445ea36 2023-10-01 16:02:11,057 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-01 16:02:11,068 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-10-01 16:02:11,069 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 630aa248a3950404422299d067525477, NAME => 'testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp 2023-10-01 16:02:11,069 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 728e85f5dd053e86e59e7dfb0445ea36, NAME => 'testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp 2023-10-01 16:02:11,082 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:02:11,082 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 728e85f5dd053e86e59e7dfb0445ea36, disabling compactions & flushes 2023-10-01 16:02:11,082 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:02:11,082 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36. 2023-10-01 16:02:11,082 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 630aa248a3950404422299d067525477, disabling compactions & flushes 2023-10-01 16:02:11,083 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36. 2023-10-01 16:02:11,083 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477. 2023-10-01 16:02:11,083 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36. after waiting 0 ms 2023-10-01 16:02:11,083 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36. 2023-10-01 16:02:11,083 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477. 2023-10-01 16:02:11,083 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36. 2023-10-01 16:02:11,083 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477. after waiting 0 ms 2023-10-01 16:02:11,083 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477. 2023-10-01 16:02:11,083 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 728e85f5dd053e86e59e7dfb0445ea36: 2023-10-01 16:02:11,083 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477. 2023-10-01 16:02:11,083 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 630aa248a3950404422299d067525477: 2023-10-01 16:02:11,086 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 16:02:11,087 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696176131086"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176131086"}]},"ts":"1696176131086"} 2023-10-01 16:02:11,087 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696176131086"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176131086"}]},"ts":"1696176131086"} 2023-10-01 16:02:11,089 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 16:02:11,090 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 16:02:11,090 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176131090"}]},"ts":"1696176131090"} 2023-10-01 16:02:11,092 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-10-01 16:02:11,097 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 16:02:11,098 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 16:02:11,098 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 16:02:11,098 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 16:02:11,098 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 16:02:11,098 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=630aa248a3950404422299d067525477, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=728e85f5dd053e86e59e7dfb0445ea36, ASSIGN}] 2023-10-01 16:02:11,101 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=728e85f5dd053e86e59e7dfb0445ea36, ASSIGN 2023-10-01 16:02:11,101 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=630aa248a3950404422299d067525477, ASSIGN 2023-10-01 16:02:11,103 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=728e85f5dd053e86e59e7dfb0445ea36, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45599,1696176089006; forceNewPlan=false, retain=false 2023-10-01 16:02:11,103 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=630aa248a3950404422299d067525477, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37191,1696176088973; forceNewPlan=false, retain=false 2023-10-01 16:02:11,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-01 16:02:11,254 INFO [jenkins-hbase4:42819] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 16:02:11,256 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=630aa248a3950404422299d067525477, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:11,256 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=728e85f5dd053e86e59e7dfb0445ea36, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:11,256 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696176131256"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176131256"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176131256"}]},"ts":"1696176131256"} 2023-10-01 16:02:11,256 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696176131256"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176131256"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176131256"}]},"ts":"1696176131256"} 2023-10-01 16:02:11,258 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 630aa248a3950404422299d067525477, server=jenkins-hbase4.apache.org,37191,1696176088973}] 2023-10-01 16:02:11,259 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 728e85f5dd053e86e59e7dfb0445ea36, server=jenkins-hbase4.apache.org,45599,1696176089006}] 2023-10-01 16:02:11,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-01 16:02:11,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36. 2023-10-01 16:02:11,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477. 2023-10-01 16:02:11,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 728e85f5dd053e86e59e7dfb0445ea36, NAME => 'testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 16:02:11,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 630aa248a3950404422299d067525477, NAME => 'testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 16:02:11,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36. service=AccessControlService 2023-10-01 16:02:11,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477. service=AccessControlService 2023-10-01 16:02:11,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 16:02:11,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 16:02:11,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 728e85f5dd053e86e59e7dfb0445ea36 2023-10-01 16:02:11,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 630aa248a3950404422299d067525477 2023-10-01 16:02:11,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:02:11,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:02:11,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 728e85f5dd053e86e59e7dfb0445ea36 2023-10-01 16:02:11,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 630aa248a3950404422299d067525477 2023-10-01 16:02:11,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 728e85f5dd053e86e59e7dfb0445ea36 2023-10-01 16:02:11,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 630aa248a3950404422299d067525477 2023-10-01 16:02:11,420 INFO [StoreOpener-728e85f5dd053e86e59e7dfb0445ea36-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 728e85f5dd053e86e59e7dfb0445ea36 2023-10-01 16:02:11,420 INFO [StoreOpener-630aa248a3950404422299d067525477-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 630aa248a3950404422299d067525477 2023-10-01 16:02:11,421 DEBUG [StoreOpener-728e85f5dd053e86e59e7dfb0445ea36-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testConsecutiveExports/728e85f5dd053e86e59e7dfb0445ea36/cf 2023-10-01 16:02:11,421 DEBUG [StoreOpener-728e85f5dd053e86e59e7dfb0445ea36-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testConsecutiveExports/728e85f5dd053e86e59e7dfb0445ea36/cf 2023-10-01 16:02:11,421 DEBUG [StoreOpener-630aa248a3950404422299d067525477-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testConsecutiveExports/630aa248a3950404422299d067525477/cf 2023-10-01 16:02:11,421 DEBUG [StoreOpener-630aa248a3950404422299d067525477-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testConsecutiveExports/630aa248a3950404422299d067525477/cf 2023-10-01 16:02:11,421 INFO [StoreOpener-728e85f5dd053e86e59e7dfb0445ea36-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 728e85f5dd053e86e59e7dfb0445ea36 columnFamilyName cf 2023-10-01 16:02:11,421 INFO [StoreOpener-630aa248a3950404422299d067525477-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 630aa248a3950404422299d067525477 columnFamilyName cf 2023-10-01 16:02:11,423 INFO [StoreOpener-728e85f5dd053e86e59e7dfb0445ea36-1] regionserver.HStore(310): Store=728e85f5dd053e86e59e7dfb0445ea36/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 16:02:11,423 INFO [StoreOpener-630aa248a3950404422299d067525477-1] regionserver.HStore(310): Store=630aa248a3950404422299d067525477/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 16:02:11,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testConsecutiveExports/728e85f5dd053e86e59e7dfb0445ea36 2023-10-01 16:02:11,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testConsecutiveExports/630aa248a3950404422299d067525477 2023-10-01 16:02:11,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testConsecutiveExports/728e85f5dd053e86e59e7dfb0445ea36 2023-10-01 16:02:11,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testConsecutiveExports/630aa248a3950404422299d067525477 2023-10-01 16:02:11,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 728e85f5dd053e86e59e7dfb0445ea36 2023-10-01 16:02:11,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 630aa248a3950404422299d067525477 2023-10-01 16:02:11,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testConsecutiveExports/728e85f5dd053e86e59e7dfb0445ea36/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 16:02:11,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testConsecutiveExports/630aa248a3950404422299d067525477/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 16:02:11,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 728e85f5dd053e86e59e7dfb0445ea36; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67123731, jitterRate=2.215355634689331E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 16:02:11,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 728e85f5dd053e86e59e7dfb0445ea36: 2023-10-01 16:02:11,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 630aa248a3950404422299d067525477; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59529584, jitterRate=-0.11294007301330566}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 16:02:11,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 630aa248a3950404422299d067525477: 2023-10-01 16:02:11,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36., pid=46, masterSystemTime=1696176131411 2023-10-01 16:02:11,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477., pid=45, masterSystemTime=1696176131410 2023-10-01 16:02:11,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36. 2023-10-01 16:02:11,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36. 2023-10-01 16:02:11,432 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=728e85f5dd053e86e59e7dfb0445ea36, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:11,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477. 2023-10-01 16:02:11,433 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696176131432"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696176131432"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696176131432"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696176131432"}]},"ts":"1696176131432"} 2023-10-01 16:02:11,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477. 2023-10-01 16:02:11,433 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=630aa248a3950404422299d067525477, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:11,433 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696176131433"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696176131433"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696176131433"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696176131433"}]},"ts":"1696176131433"} 2023-10-01 16:02:11,436 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-10-01 16:02:11,437 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 728e85f5dd053e86e59e7dfb0445ea36, server=jenkins-hbase4.apache.org,45599,1696176089006 in 175 msec 2023-10-01 16:02:11,437 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-10-01 16:02:11,438 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 630aa248a3950404422299d067525477, server=jenkins-hbase4.apache.org,37191,1696176088973 in 177 msec 2023-10-01 16:02:11,438 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=728e85f5dd053e86e59e7dfb0445ea36, ASSIGN in 339 msec 2023-10-01 16:02:11,440 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-10-01 16:02:11,440 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=630aa248a3950404422299d067525477, ASSIGN in 340 msec 2023-10-01 16:02:11,441 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 16:02:11,441 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176131441"}]},"ts":"1696176131441"} 2023-10-01 16:02:11,442 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-10-01 16:02:11,444 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 16:02:11,445 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-10-01 16:02:11,446 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37191] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-01 16:02:11,448 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:11,448 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:11,448 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:11,448 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:11,449 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-01 16:02:11,449 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-01 16:02:11,449 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-01 16:02:11,449 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-01 16:02:11,451 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 401 msec 2023-10-01 16:02:11,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-01 16:02:11,657 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-10-01 16:02:11,660 DEBUG [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-01 16:02:11,660 DEBUG [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477. 2023-10-01 16:02:11,663 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 16:02:11,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 16:02:11,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696176131675 (current time:1696176131675). 2023-10-01 16:02:11,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 16:02:11,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x6990fd89 to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:02:11,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c851c95, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:02:11,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:02:11,686 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36284, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:02:11,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6990fd89 to 127.0.0.1:60886 2023-10-01 16:02:11,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:02:11,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x52ee2e01 to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:02:11,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c7cfd60, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:02:11,696 DEBUG [hconnection-0x58f92fce-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:02:11,699 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36294, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:02:11,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:02:11,704 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45464, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:02:11,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52ee2e01 to 127.0.0.1:60886 2023-10-01 16:02:11,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:02:11,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-01 16:02:11,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 16:02:11,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 16:02:11,709 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot, current working dir path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 16:02:11,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 16:02:11,711 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 16:02:11,712 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696176731712 2023-10-01 16:02:11,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 16:02:11,712 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-01 16:02:11,713 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 16:02:11,713 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 16:02:11,714 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 16:02:11,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 16:02:11,715 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-10-01 16:02:11,716 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 16:02:11,717 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696176731717 2023-10-01 16:02:11,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,737 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-10-01 16:02:11,737 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:11,738 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-10-01 16:02:11,738 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-01 16:02:11,738 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,738 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,741 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:11,741 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:11,741 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:11,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:11,741 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:11,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:11,741 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:11,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:11,742 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:11,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:11,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:11,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:11,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,742 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:11,742 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 16:02:11,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,743 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-01 16:02:11,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,743 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 16:02:11,743 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,743 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 16:02:11,743 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:11,744 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 16:02:11,745 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-01 16:02:11,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-01 16:02:11,745 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38419,1696176088917' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-01 16:02:11,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-01 16:02:11,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,745 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 16:02:11,745 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 16:02:11,745 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,745 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 16:02:11,745 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,745 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:11,745 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 16:02:11,746 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:11,746 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 16:02:11,749 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-01 16:02:11,750 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,749 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 16:02:11,750 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-01 16:02:11,750 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37191,1696176088973' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-01 16:02:11,750 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45599,1696176089006' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-01 16:02:11,750 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,750 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:02:11,751 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:11,751 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,751 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,751 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:11,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:11,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:11,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:11,752 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,752 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,752 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:02:11,752 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:02:11,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:11,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:11,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:11,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:11,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:11,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:11,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37191,1696176088973' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-01 16:02:11,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@176389b3[Count = 1] remaining members to acquire global barrier 2023-10-01 16:02:11,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:11,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:11,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:11,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:11,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:11,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:11,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:11,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:11,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:11,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45599,1696176089006' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-01 16:02:11,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@176389b3[Count = 0] remaining members to acquire global barrier 2023-10-01 16:02:11,756 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-01 16:02:11,756 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,757 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,757 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,757 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,758 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 16:02:11,758 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:11,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,758 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-01 16:02:11,758 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 16:02:11,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,758 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38419,1696176088917' in zk 2023-10-01 16:02:11,758 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 16:02:11,758 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 16:02:11,758 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 16:02:11,758 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477. 2023-10-01 16:02:11,758 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 16:02:11,758 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 16:02:11,758 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36. 2023-10-01 16:02:11,758 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:11,758 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 16:02:11,758 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36. started... 2023-10-01 16:02:11,758 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477. started... 2023-10-01 16:02:11,760 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 630aa248a3950404422299d067525477: 2023-10-01 16:02:11,760 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 728e85f5dd053e86e59e7dfb0445ea36: 2023-10-01 16:02:11,760 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,760 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 16:02:11,760 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 16:02:11,760 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,761 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 16:02:11,761 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 16:02:11,765 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 16:02:11,765 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:11,765 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-01 16:02:11,773 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477. completed. 2023-10-01 16:02:11,773 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477. 2023-10-01 16:02:11,773 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 16:02:11,773 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 16:02:11,773 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:11,773 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-01 16:02:11,773 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37191,1696176088973' in zk 2023-10-01 16:02:11,775 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36. completed. 2023-10-01 16:02:11,775 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36. 2023-10-01 16:02:11,775 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 16:02:11,775 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 16:02:11,775 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:11,775 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-01 16:02:11,775 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45599,1696176089006' in zk 2023-10-01 16:02:11,775 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:11,775 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 16:02:11,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:11,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:11,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:11,775 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:11,776 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-01 16:02:11,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:11,778 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:11,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:11,778 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 16:02:11,778 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:11,778 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-01 16:02:11,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:11,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:11,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:11,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:11,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:11,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:11,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:11,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37191,1696176088973': 2023-10-01 16:02:11,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37191,1696176088973' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-01 16:02:11,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:11,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:11,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:11,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:11,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:11,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:11,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:11,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:11,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:11,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:11,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:11,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:11,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45599,1696176089006': 2023-10-01 16:02:11,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45599,1696176089006' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-01 16:02:11,785 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-10-01 16:02:11,785 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 16:02:11,785 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 16:02:11,785 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,785 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 16:02:11,787 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,787 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,787 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,787 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:11,787 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:11,787 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,787 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:11,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:11,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:11,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:11,788 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:11,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:11,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:11,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:11,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:11,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:11,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,790 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:11,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:11,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,790 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:11,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:11,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:11,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:11,792 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:11,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:11,792 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:11,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:11,792 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:11,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:11,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:11,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:11,798 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:11,798 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:11,798 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,798 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:11,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:11,798 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:11,798 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,798 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:11,798 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-01 16:02:11,798 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:11,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:11,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,798 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:11,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 16:02:11,798 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:11,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:11,798 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:11,798 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:11,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:11,798 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:11,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:11,800 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:11,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:11,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:11,800 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 16:02:11,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:11,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:11,800 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:11,800 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:11,800 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,800 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:11,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:11,808 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,808 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,813 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 16:02:11,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-01 16:02:11,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-01 16:02:11,815 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 16:02:11,830 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,831 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-01 16:02:11,831 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,832 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:11,832 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696176131712Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696176131808 (+96 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1696176131808Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1696176131808Writing data manifest for emptySnaptb0-testConsecutiveExports at 1696176131815 (+7 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1696176131825 (+10 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696176131831 (+6 ms) 2023-10-01 16:02:11,834 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 16:02:11,836 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 121 msec 2023-10-01 16:02:12,015 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 16:02:12,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-01 16:02:12,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 16:02:12,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37191] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 16:02:12,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45599] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 16:02:12,025 DEBUG [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-01 16:02:12,025 DEBUG [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477. 2023-10-01 16:02:12,026 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 16:02:12,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 16:02:12,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696176132038 (current time:1696176132038). 2023-10-01 16:02:12,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 16:02:12,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x40ab4cae to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:02:12,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29a5d09, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:02:12,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:02:12,056 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:02:12,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40ab4cae to 127.0.0.1:60886 2023-10-01 16:02:12,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:02:12,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x27325b44 to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:02:12,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d66ad30, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:02:12,067 DEBUG [hconnection-0x6d44dd80-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:02:12,070 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:02:12,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:02:12,076 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45476, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:02:12,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27325b44 to 127.0.0.1:60886 2023-10-01 16:02:12,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:02:12,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-01 16:02:12,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 16:02:12,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 16:02:12,081 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot, current working dir path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 16:02:12,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 16:02:12,084 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 16:02:12,085 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696176732085 2023-10-01 16:02:12,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 16:02:12,085 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-01 16:02:12,087 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 16:02:12,090 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 16:02:12,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 16:02:12,090 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 16:02:12,092 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-10-01 16:02:12,092 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 16:02:12,093 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696176732093 2023-10-01 16:02:12,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-10-01 16:02:12,104 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-10-01 16:02:12,104 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:12,105 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-10-01 16:02:12,105 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-01 16:02:12,106 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,106 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,107 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:12,107 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:12,107 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:12,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:12,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:12,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:12,108 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:12,107 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:12,108 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:12,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:12,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:12,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:12,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,108 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:12,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,108 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 16:02:12,108 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,109 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,109 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-01 16:02:12,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-01 16:02:12,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,109 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 16:02:12,109 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 16:02:12,109 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-01 16:02:12,109 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 16:02:12,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-01 16:02:12,110 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-01 16:02:12,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,110 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 16:02:12,110 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:12,110 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:12,111 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 16:02:12,110 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 16:02:12,112 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-01 16:02:12,112 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 16:02:12,112 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-01 16:02:12,112 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37191,1696176088973' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-01 16:02:12,112 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45599,1696176089006' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-01 16:02:12,113 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-01 16:02:12,113 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 16:02:12,113 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:12,114 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 16:02:12,114 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-01 16:02:12,114 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38419,1696176088917' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-01 16:02:12,114 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,114 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:12,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:12,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:12,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:12,115 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:12,115 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:12,115 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,115 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:02:12,117 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,117 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,117 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:02:12,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:12,118 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,118 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:02:12,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 16:02:12,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:12,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:12,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:12,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:12,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37191,1696176088973' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-01 16:02:12,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@180b2941[Count = 1] remaining members to acquire global barrier 2023-10-01 16:02:12,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:12,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:12,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:12,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:12,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:12,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 16:02:12,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:12,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:12,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:12,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:12,121 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45599,1696176089006' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-01 16:02:12,121 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@180b2941[Count = 0] remaining members to acquire global barrier 2023-10-01 16:02:12,121 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-01 16:02:12,121 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,123 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,123 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,123 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,123 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:12,123 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 16:02:12,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,123 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 16:02:12,123 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 16:02:12,123 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 16:02:12,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,123 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 16:02:12,123 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 16:02:12,123 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477. 2023-10-01 16:02:12,123 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36. 2023-10-01 16:02:12,124 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477. started... 2023-10-01 16:02:12,124 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36. started... 2023-10-01 16:02:12,123 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-01 16:02:12,123 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:12,124 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 16:02:12,123 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 16:02:12,124 INFO [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 728e85f5dd053e86e59e7dfb0445ea36 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-10-01 16:02:12,124 INFO [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 630aa248a3950404422299d067525477 1/1 column families, dataSize=132 B heapSize=544 B 2023-10-01 16:02:12,124 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38419,1696176088917' in zk 2023-10-01 16:02:12,126 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 16:02:12,126 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:12,126 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-01 16:02:12,157 INFO [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231001f4fb13d61f5447449e75c48761444d36 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231001f4fb13d61f5447449e75c48761444d36 2023-10-01 16:02:12,158 INFO [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231001a06ae135ab9f49ebae98b0808ceade0b to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231001a06ae135ab9f49ebae98b0808ceade0b 2023-10-01 16:02:12,172 INFO [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testConsecutiveExports/630aa248a3950404422299d067525477/.tmp/cf/53d8d25ab72a46a78568ed32acd117e1 2023-10-01 16:02:12,172 INFO [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testConsecutiveExports/728e85f5dd053e86e59e7dfb0445ea36/.tmp/cf/5e29a0a1501d4af3801df866a29d5589 2023-10-01 16:02:12,178 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testConsecutiveExports/728e85f5dd053e86e59e7dfb0445ea36/.tmp/cf/5e29a0a1501d4af3801df866a29d5589 as hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testConsecutiveExports/728e85f5dd053e86e59e7dfb0445ea36/cf/5e29a0a1501d4af3801df866a29d5589 2023-10-01 16:02:12,178 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testConsecutiveExports/630aa248a3950404422299d067525477/.tmp/cf/53d8d25ab72a46a78568ed32acd117e1 as hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testConsecutiveExports/630aa248a3950404422299d067525477/cf/53d8d25ab72a46a78568ed32acd117e1 2023-10-01 16:02:12,183 INFO [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testConsecutiveExports/728e85f5dd053e86e59e7dfb0445ea36/cf/5e29a0a1501d4af3801df866a29d5589, entries=48, sequenceid=6, filesize=12.9 K 2023-10-01 16:02:12,184 INFO [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testConsecutiveExports/630aa248a3950404422299d067525477/cf/53d8d25ab72a46a78568ed32acd117e1, entries=2, sequenceid=6, filesize=5.2 K 2023-10-01 16:02:12,184 INFO [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 728e85f5dd053e86e59e7dfb0445ea36 in 60ms, sequenceid=6, compaction requested=false 2023-10-01 16:02:12,184 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-01 16:02:12,185 INFO [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 630aa248a3950404422299d067525477 in 61ms, sequenceid=6, compaction requested=false 2023-10-01 16:02:12,185 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-01 16:02:12,185 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 728e85f5dd053e86e59e7dfb0445ea36: 2023-10-01 16:02:12,186 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 630aa248a3950404422299d067525477: 2023-10-01 16:02:12,187 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-01 16:02:12,187 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-01 16:02:12,187 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 16:02:12,187 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 16:02:12,187 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testConsecutiveExports/728e85f5dd053e86e59e7dfb0445ea36/cf/5e29a0a1501d4af3801df866a29d5589] hfiles 2023-10-01 16:02:12,187 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testConsecutiveExports/630aa248a3950404422299d067525477/cf/53d8d25ab72a46a78568ed32acd117e1] hfiles 2023-10-01 16:02:12,187 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testConsecutiveExports/728e85f5dd053e86e59e7dfb0445ea36/cf/5e29a0a1501d4af3801df866a29d5589 for snapshot=snaptb0-testConsecutiveExports 2023-10-01 16:02:12,187 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testConsecutiveExports/630aa248a3950404422299d067525477/cf/53d8d25ab72a46a78568ed32acd117e1 for snapshot=snaptb0-testConsecutiveExports 2023-10-01 16:02:12,191 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 16:02:12,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-01 16:02:12,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-01 16:02:12,192 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 16:02:12,196 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36. completed. 2023-10-01 16:02:12,196 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36. 2023-10-01 16:02:12,196 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 16:02:12,196 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 16:02:12,196 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:12,196 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477. completed. 2023-10-01 16:02:12,196 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-01 16:02:12,196 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477. 2023-10-01 16:02:12,196 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45599,1696176089006' in zk 2023-10-01 16:02:12,196 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 16:02:12,196 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 16:02:12,196 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:12,196 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-01 16:02:12,196 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37191,1696176088973' in zk 2023-10-01 16:02:12,198 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:12,198 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 16:02:12,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:12,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:12,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:12,198 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:12,198 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:12,198 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 16:02:12,198 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-01 16:02:12,200 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:12,200 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-01 16:02:12,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:12,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:12,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 16:02:12,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:12,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:12,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:12,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:12,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 16:02:12,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:12,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:12,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:12,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45599,1696176089006': 2023-10-01 16:02:12,204 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45599,1696176089006' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-01 16:02:12,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:12,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:12,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:12,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:12,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:12,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 16:02:12,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:12,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:12,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:12,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:12,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 16:02:12,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:12,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:12,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:12,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37191,1696176088973': 2023-10-01 16:02:12,208 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37191,1696176088973' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-01 16:02:12,208 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-10-01 16:02:12,208 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 16:02:12,208 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 16:02:12,208 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-10-01 16:02:12,208 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 16:02:12,211 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,211 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,211 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:12,211 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:12,211 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,211 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:12,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:12,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,211 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:12,212 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:12,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:12,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:12,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:12,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:12,212 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:12,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:12,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:12,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:12,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 16:02:12,213 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:12,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:12,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 16:02:12,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:12,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:12,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:12,215 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:12,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:12,215 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:12,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 16:02:12,216 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:12,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:12,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:12,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:12,221 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:12,221 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:12,221 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:12,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:12,222 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:12,221 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:12,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:12,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:12,221 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:12,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:12,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:12,222 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:12,222 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-10-01 16:02:12,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:12,222 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:12,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:12,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:12,221 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,222 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-01 16:02:12,224 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:12,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:12,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:12,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:12,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:12,224 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-01 16:02:12,224 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:12,224 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,224 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:12,224 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 16:02:12,224 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,224 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:12,224 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:12,224 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,224 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,225 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231001a06ae135ab9f49ebae98b0808ceade0b, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231001f4fb13d61f5447449e75c48761444d36] mob files 2023-10-01 16:02:12,225 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231001a06ae135ab9f49ebae98b0808ceade0b 2023-10-01 16:02:12,225 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231001f4fb13d61f5447449e75c48761444d36 2023-10-01 16:02:12,236 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-10-01 16:02:12,236 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,260 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,260 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-01 16:02:12,260 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,261 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696176132086Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696176132236 (+150 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1696176132236Loading Region manifests for snaptb0-testConsecutiveExports at 1696176132236Writing data manifest for snaptb0-testConsecutiveExports at 1696176132240 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1696176132253 (+13 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696176132260 (+7 ms) 2023-10-01 16:02:12,263 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 16:02:12,265 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 176 msec 2023-10-01 16:02:12,392 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 16:02:12,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-01 16:02:12,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 16:02:12,394 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/local-export-1696176132394 2023-10-01 16:02:12,394 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/local-export-1696176132394, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/local-export-1696176132394, srcFsUri=hdfs://localhost:44103, srcDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc 2023-10-01 16:02:12,415 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44103, inputRoot=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc 2023-10-01 16:02:12,415 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@59cd5b80, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/local-export-1696176132394, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/local-export-1696176132394/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,415 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44103, inputRoot=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc, snapshotDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-01 16:02:12,424 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/local-export-1696176132394/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 16:02:12,435 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:12,435 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:12,436 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:12,436 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:13,332 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/hadoop-4245437668976869282.jar 2023-10-01 16:02:13,332 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:13,333 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:13,399 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/hadoop-4124939886177856144.jar 2023-10-01 16:02:13,400 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:13,400 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:13,400 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:13,401 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:13,401 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:13,402 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:13,402 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 16:02:13,402 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 16:02:13,403 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 16:02:13,403 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 16:02:13,403 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 16:02:13,404 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 16:02:13,404 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 16:02:13,405 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 16:02:13,405 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 16:02:13,405 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 16:02:13,406 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:02:13,406 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:02:13,407 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 16:02:13,407 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:02:13,407 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:02:13,408 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 16:02:13,409 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 16:02:13,808 WARN [Listener at jenkins-hbase4.apache.org/36093] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 16:02:13,810 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-01 16:02:13,812 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-01 16:02:15,091 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 16:02:15,091 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 16:02:15,094 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0002_000001 (auth:SIMPLE) 2023-10-01 16:02:15,885 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0003_000001 (auth:SIMPLE) 2023-10-01 16:02:16,331 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 16:02:19,672 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0003_000001 (auth:SIMPLE) 2023-10-01 16:02:21,887 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0003_000001 (auth:SIMPLE) 2023-10-01 16:02:24,233 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0003_000001 (auth:SIMPLE) 2023-10-01 16:02:25,977 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 16:02:25,977 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 16:02:25,981 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-01 16:02:25,981 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 16:02:25,982 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 16:02:25,982 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1478872176_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-01 16:02:25,985 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-01 16:02:25,985 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-01 16:02:25,985 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5e9fdd86 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/local-export-1696176132394/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/local-export-1696176132394/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-01 16:02:25,985 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/local-export-1696176132394/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-01 16:02:25,985 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/local-export-1696176132394/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-01 16:02:25,986 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/local-export-1696176132394, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/local-export-1696176132394, srcFsUri=hdfs://localhost:44103, srcDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc 2023-10-01 16:02:26,008 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44103, inputRoot=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc 2023-10-01 16:02:26,008 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@380997f2, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/local-export-1696176132394, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/local-export-1696176132394/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 16:02:26,008 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44103, inputRoot=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc, snapshotDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-01 16:02:26,021 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/local-export-1696176132394/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 16:02:26,033 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:26,033 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:26,034 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:26,034 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:26,907 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/hadoop-8520821284426096941.jar 2023-10-01 16:02:26,907 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:26,907 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:26,974 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/hadoop-1086294132907908268.jar 2023-10-01 16:02:26,974 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:26,975 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:26,975 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:26,975 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:26,976 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:26,976 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:26,977 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 16:02:26,978 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 16:02:26,978 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 16:02:26,979 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 16:02:26,979 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 16:02:26,980 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 16:02:26,981 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 16:02:26,981 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 16:02:26,982 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 16:02:26,983 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 16:02:26,984 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:02:26,984 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:02:26,985 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 16:02:26,986 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:02:26,986 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:02:26,987 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 16:02:26,988 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 16:02:27,348 WARN [Listener at jenkins-hbase4.apache.org/36093] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 16:02:27,350 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-01 16:02:27,352 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-01 16:02:30,404 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 16:02:30,404 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 16:02:30,409 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0003_000001 (auth:SIMPLE) 2023-10-01 16:02:31,103 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0004_000001 (auth:SIMPLE) 2023-10-01 16:02:34,914 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0004_000001 (auth:SIMPLE) 2023-10-01 16:02:37,149 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0004_000001 (auth:SIMPLE) 2023-10-01 16:02:39,382 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0004_000001 (auth:SIMPLE) 2023-10-01 16:02:40,508 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 16:02:40,508 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 16:02:40,511 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-01 16:02:40,511 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 16:02:40,512 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 16:02:40,512 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1478872176_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-01 16:02:40,516 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-01 16:02:40,516 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-01 16:02:40,516 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5e9fdd86 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/local-export-1696176132394/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/local-export-1696176132394/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-01 16:02:40,516 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/local-export-1696176132394/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-01 16:02:40,516 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/local-export-1696176132394/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-01 16:02:40,528 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-10-01 16:02:40,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-10-01 16:02:40,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-10-01 16:02:40,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-01 16:02:40,533 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176160533"}]},"ts":"1696176160533"} 2023-10-01 16:02:40,535 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-10-01 16:02:40,536 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-10-01 16:02:40,537 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=630aa248a3950404422299d067525477, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=728e85f5dd053e86e59e7dfb0445ea36, UNASSIGN}] 2023-10-01 16:02:40,539 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=630aa248a3950404422299d067525477, UNASSIGN 2023-10-01 16:02:40,539 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=728e85f5dd053e86e59e7dfb0445ea36, UNASSIGN 2023-10-01 16:02:40,540 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=728e85f5dd053e86e59e7dfb0445ea36, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:40,540 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=630aa248a3950404422299d067525477, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:40,540 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696176160540"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176160540"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176160540"}]},"ts":"1696176160540"} 2023-10-01 16:02:40,540 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696176160540"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176160540"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176160540"}]},"ts":"1696176160540"} 2023-10-01 16:02:40,541 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 728e85f5dd053e86e59e7dfb0445ea36, server=jenkins-hbase4.apache.org,45599,1696176089006}] 2023-10-01 16:02:40,542 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 630aa248a3950404422299d067525477, server=jenkins-hbase4.apache.org,37191,1696176088973}] 2023-10-01 16:02:40,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-01 16:02:40,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 728e85f5dd053e86e59e7dfb0445ea36 2023-10-01 16:02:40,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 728e85f5dd053e86e59e7dfb0445ea36, disabling compactions & flushes 2023-10-01 16:02:40,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36. 2023-10-01 16:02:40,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36. 2023-10-01 16:02:40,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36. after waiting 0 ms 2023-10-01 16:02:40,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36. 2023-10-01 16:02:40,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 630aa248a3950404422299d067525477 2023-10-01 16:02:40,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 630aa248a3950404422299d067525477, disabling compactions & flushes 2023-10-01 16:02:40,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477. 2023-10-01 16:02:40,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477. 2023-10-01 16:02:40,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477. after waiting 0 ms 2023-10-01 16:02:40,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477. 2023-10-01 16:02:40,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testConsecutiveExports/728e85f5dd053e86e59e7dfb0445ea36/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 16:02:40,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testConsecutiveExports/630aa248a3950404422299d067525477/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 16:02:40,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 16:02:40,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 16:02:40,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36. 2023-10-01 16:02:40,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477. 2023-10-01 16:02:40,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 630aa248a3950404422299d067525477: 2023-10-01 16:02:40,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 728e85f5dd053e86e59e7dfb0445ea36: 2023-10-01 16:02:40,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 630aa248a3950404422299d067525477 2023-10-01 16:02:40,709 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=630aa248a3950404422299d067525477, regionState=CLOSED 2023-10-01 16:02:40,709 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696176160709"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176160709"}]},"ts":"1696176160709"} 2023-10-01 16:02:40,709 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 728e85f5dd053e86e59e7dfb0445ea36 2023-10-01 16:02:40,710 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=728e85f5dd053e86e59e7dfb0445ea36, regionState=CLOSED 2023-10-01 16:02:40,710 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696176160710"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176160710"}]},"ts":"1696176160710"} 2023-10-01 16:02:40,712 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=52 2023-10-01 16:02:40,712 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 630aa248a3950404422299d067525477, server=jenkins-hbase4.apache.org,37191,1696176088973 in 169 msec 2023-10-01 16:02:40,713 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=53 2023-10-01 16:02:40,713 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 728e85f5dd053e86e59e7dfb0445ea36, server=jenkins-hbase4.apache.org,45599,1696176089006 in 170 msec 2023-10-01 16:02:40,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=630aa248a3950404422299d067525477, UNASSIGN in 175 msec 2023-10-01 16:02:40,715 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-10-01 16:02:40,715 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=728e85f5dd053e86e59e7dfb0445ea36, UNASSIGN in 176 msec 2023-10-01 16:02:40,716 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176160716"}]},"ts":"1696176160716"} 2023-10-01 16:02:40,717 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-10-01 16:02:40,720 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-10-01 16:02:40,722 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 191 msec 2023-10-01 16:02:40,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-01 16:02:40,836 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-10-01 16:02:40,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-10-01 16:02:40,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 16:02:40,840 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 16:02:40,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-10-01 16:02:40,840 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 16:02:40,844 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37191] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-10-01 16:02:40,847 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 16:02:40,847 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 16:02:40,847 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 16:02:40,847 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 16:02:40,847 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-01 16:02:40,847 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-01 16:02:40,848 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-01 16:02:40,847 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-01 16:02:40,847 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testConsecutiveExports/630aa248a3950404422299d067525477 2023-10-01 16:02:40,847 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testConsecutiveExports/728e85f5dd053e86e59e7dfb0445ea36 2023-10-01 16:02:40,848 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 16:02:40,848 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 16:02:40,848 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:40,848 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 16:02:40,848 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 16:02:40,848 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:40,848 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:40,849 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:40,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-01 16:02:40,850 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testConsecutiveExports/728e85f5dd053e86e59e7dfb0445ea36/cf, FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testConsecutiveExports/728e85f5dd053e86e59e7dfb0445ea36/recovered.edits] 2023-10-01 16:02:40,850 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testConsecutiveExports/630aa248a3950404422299d067525477/cf, FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testConsecutiveExports/630aa248a3950404422299d067525477/recovered.edits] 2023-10-01 16:02:40,856 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testConsecutiveExports/728e85f5dd053e86e59e7dfb0445ea36/cf/5e29a0a1501d4af3801df866a29d5589 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testConsecutiveExports/728e85f5dd053e86e59e7dfb0445ea36/cf/5e29a0a1501d4af3801df866a29d5589 2023-10-01 16:02:40,856 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testConsecutiveExports/630aa248a3950404422299d067525477/cf/53d8d25ab72a46a78568ed32acd117e1 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testConsecutiveExports/630aa248a3950404422299d067525477/cf/53d8d25ab72a46a78568ed32acd117e1 2023-10-01 16:02:40,859 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testConsecutiveExports/728e85f5dd053e86e59e7dfb0445ea36/recovered.edits/9.seqid to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testConsecutiveExports/728e85f5dd053e86e59e7dfb0445ea36/recovered.edits/9.seqid 2023-10-01 16:02:40,860 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testConsecutiveExports/630aa248a3950404422299d067525477/recovered.edits/9.seqid to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testConsecutiveExports/630aa248a3950404422299d067525477/recovered.edits/9.seqid 2023-10-01 16:02:40,860 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testConsecutiveExports/728e85f5dd053e86e59e7dfb0445ea36 2023-10-01 16:02:40,860 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testConsecutiveExports/630aa248a3950404422299d067525477 2023-10-01 16:02:40,860 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-01 16:02:40,861 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-01 16:02:40,861 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-10-01 16:02:40,864 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231001a06ae135ab9f49ebae98b0808ceade0b to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231001a06ae135ab9f49ebae98b0808ceade0b 2023-10-01 16:02:40,866 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231001f4fb13d61f5447449e75c48761444d36 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231001f4fb13d61f5447449e75c48761444d36 2023-10-01 16:02:40,866 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-01 16:02:40,869 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 16:02:40,871 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-10-01 16:02:40,873 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-10-01 16:02:40,874 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 16:02:40,874 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-10-01 16:02:40,874 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696176160874"}]},"ts":"9223372036854775807"} 2023-10-01 16:02:40,875 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696176160874"}]},"ts":"9223372036854775807"} 2023-10-01 16:02:40,876 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 16:02:40,876 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 630aa248a3950404422299d067525477, NAME => 'testtb-testConsecutiveExports,,1696176131048.630aa248a3950404422299d067525477.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 728e85f5dd053e86e59e7dfb0445ea36, NAME => 'testtb-testConsecutiveExports,1,1696176131048.728e85f5dd053e86e59e7dfb0445ea36.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 16:02:40,876 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-10-01 16:02:40,877 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696176160877"}]},"ts":"9223372036854775807"} 2023-10-01 16:02:40,878 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-10-01 16:02:40,881 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 16:02:40,882 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 44 msec 2023-10-01 16:02:40,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-01 16:02:40,951 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-10-01 16:02:40,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-10-01 16:02:40,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-10-01 16:02:40,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-10-01 16:02:40,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testConsecutiveExports 2023-10-01 16:02:40,988 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=748 (was 765), OpenFileDescriptor=901 (was 934), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=196 (was 172) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=1372 (was 1535) 2023-10-01 16:02:40,988 WARN [Listener at jenkins-hbase4.apache.org/36093] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-10-01 16:02:41,008 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=748, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=196, ProcessCount=168, AvailableMemoryMB=1371 2023-10-01 16:02:41,008 WARN [Listener at jenkins-hbase4.apache.org/36093] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-10-01 16:02:41,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 16:02:41,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,013 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 16:02:41,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-10-01 16:02:41,014 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 16:02:41,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-01 16:02:41,017 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bb2dec7154ffd8199d878f1bc69b3fbd 2023-10-01 16:02:41,017 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca98aa53e72d2e7fc3ea84eb14452a1a 2023-10-01 16:02:41,018 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bb2dec7154ffd8199d878f1bc69b3fbd empty. 2023-10-01 16:02:41,018 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca98aa53e72d2e7fc3ea84eb14452a1a empty. 2023-10-01 16:02:41,018 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bb2dec7154ffd8199d878f1bc69b3fbd 2023-10-01 16:02:41,018 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca98aa53e72d2e7fc3ea84eb14452a1a 2023-10-01 16:02:41,018 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-01 16:02:41,030 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-10-01 16:02:41,031 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => bb2dec7154ffd8199d878f1bc69b3fbd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp 2023-10-01 16:02:41,032 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => ca98aa53e72d2e7fc3ea84eb14452a1a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp 2023-10-01 16:02:41,048 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:02:41,049 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing bb2dec7154ffd8199d878f1bc69b3fbd, disabling compactions & flushes 2023-10-01 16:02:41,049 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd. 2023-10-01 16:02:41,049 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd. 2023-10-01 16:02:41,049 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd. after waiting 0 ms 2023-10-01 16:02:41,049 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:02:41,049 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd. 2023-10-01 16:02:41,049 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing ca98aa53e72d2e7fc3ea84eb14452a1a, disabling compactions & flushes 2023-10-01 16:02:41,049 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd. 2023-10-01 16:02:41,049 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a. 2023-10-01 16:02:41,049 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for bb2dec7154ffd8199d878f1bc69b3fbd: 2023-10-01 16:02:41,049 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a. 2023-10-01 16:02:41,049 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a. after waiting 0 ms 2023-10-01 16:02:41,049 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a. 2023-10-01 16:02:41,049 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a. 2023-10-01 16:02:41,049 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for ca98aa53e72d2e7fc3ea84eb14452a1a: 2023-10-01 16:02:41,052 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 16:02:41,053 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696176161053"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176161053"}]},"ts":"1696176161053"} 2023-10-01 16:02:41,053 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696176161053"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176161053"}]},"ts":"1696176161053"} 2023-10-01 16:02:41,059 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 16:02:41,060 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 16:02:41,061 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176161060"}]},"ts":"1696176161060"} 2023-10-01 16:02:41,062 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-10-01 16:02:41,065 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 16:02:41,066 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 16:02:41,066 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 16:02:41,066 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 16:02:41,066 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 16:02:41,066 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bb2dec7154ffd8199d878f1bc69b3fbd, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca98aa53e72d2e7fc3ea84eb14452a1a, ASSIGN}] 2023-10-01 16:02:41,069 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bb2dec7154ffd8199d878f1bc69b3fbd, ASSIGN 2023-10-01 16:02:41,069 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca98aa53e72d2e7fc3ea84eb14452a1a, ASSIGN 2023-10-01 16:02:41,069 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bb2dec7154ffd8199d878f1bc69b3fbd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37191,1696176088973; forceNewPlan=false, retain=false 2023-10-01 16:02:41,070 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca98aa53e72d2e7fc3ea84eb14452a1a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38419,1696176088917; forceNewPlan=false, retain=false 2023-10-01 16:02:41,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-01 16:02:41,220 INFO [jenkins-hbase4:42819] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 16:02:41,222 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=ca98aa53e72d2e7fc3ea84eb14452a1a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,222 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=bb2dec7154ffd8199d878f1bc69b3fbd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,222 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696176161222"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176161222"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176161222"}]},"ts":"1696176161222"} 2023-10-01 16:02:41,223 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696176161222"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176161222"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176161222"}]},"ts":"1696176161222"} 2023-10-01 16:02:41,224 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure ca98aa53e72d2e7fc3ea84eb14452a1a, server=jenkins-hbase4.apache.org,38419,1696176088917}] 2023-10-01 16:02:41,225 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure bb2dec7154ffd8199d878f1bc69b3fbd, server=jenkins-hbase4.apache.org,37191,1696176088973}] 2023-10-01 16:02:41,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-01 16:02:41,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd. 2023-10-01 16:02:41,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a. 2023-10-01 16:02:41,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bb2dec7154ffd8199d878f1bc69b3fbd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 16:02:41,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ca98aa53e72d2e7fc3ea84eb14452a1a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 16:02:41,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd. service=AccessControlService 2023-10-01 16:02:41,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a. service=AccessControlService 2023-10-01 16:02:41,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 16:02:41,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 16:02:41,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion bb2dec7154ffd8199d878f1bc69b3fbd 2023-10-01 16:02:41,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion ca98aa53e72d2e7fc3ea84eb14452a1a 2023-10-01 16:02:41,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:02:41,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:02:41,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bb2dec7154ffd8199d878f1bc69b3fbd 2023-10-01 16:02:41,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ca98aa53e72d2e7fc3ea84eb14452a1a 2023-10-01 16:02:41,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bb2dec7154ffd8199d878f1bc69b3fbd 2023-10-01 16:02:41,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ca98aa53e72d2e7fc3ea84eb14452a1a 2023-10-01 16:02:41,385 INFO [StoreOpener-ca98aa53e72d2e7fc3ea84eb14452a1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ca98aa53e72d2e7fc3ea84eb14452a1a 2023-10-01 16:02:41,385 INFO [StoreOpener-bb2dec7154ffd8199d878f1bc69b3fbd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bb2dec7154ffd8199d878f1bc69b3fbd 2023-10-01 16:02:41,387 DEBUG [StoreOpener-ca98aa53e72d2e7fc3ea84eb14452a1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca98aa53e72d2e7fc3ea84eb14452a1a/cf 2023-10-01 16:02:41,387 DEBUG [StoreOpener-ca98aa53e72d2e7fc3ea84eb14452a1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca98aa53e72d2e7fc3ea84eb14452a1a/cf 2023-10-01 16:02:41,387 DEBUG [StoreOpener-bb2dec7154ffd8199d878f1bc69b3fbd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion/bb2dec7154ffd8199d878f1bc69b3fbd/cf 2023-10-01 16:02:41,387 DEBUG [StoreOpener-bb2dec7154ffd8199d878f1bc69b3fbd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion/bb2dec7154ffd8199d878f1bc69b3fbd/cf 2023-10-01 16:02:41,388 INFO [StoreOpener-ca98aa53e72d2e7fc3ea84eb14452a1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca98aa53e72d2e7fc3ea84eb14452a1a columnFamilyName cf 2023-10-01 16:02:41,388 INFO [StoreOpener-bb2dec7154ffd8199d878f1bc69b3fbd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb2dec7154ffd8199d878f1bc69b3fbd columnFamilyName cf 2023-10-01 16:02:41,389 INFO [StoreOpener-bb2dec7154ffd8199d878f1bc69b3fbd-1] regionserver.HStore(310): Store=bb2dec7154ffd8199d878f1bc69b3fbd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 16:02:41,389 INFO [StoreOpener-ca98aa53e72d2e7fc3ea84eb14452a1a-1] regionserver.HStore(310): Store=ca98aa53e72d2e7fc3ea84eb14452a1a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 16:02:41,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca98aa53e72d2e7fc3ea84eb14452a1a 2023-10-01 16:02:41,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion/bb2dec7154ffd8199d878f1bc69b3fbd 2023-10-01 16:02:41,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca98aa53e72d2e7fc3ea84eb14452a1a 2023-10-01 16:02:41,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion/bb2dec7154ffd8199d878f1bc69b3fbd 2023-10-01 16:02:41,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bb2dec7154ffd8199d878f1bc69b3fbd 2023-10-01 16:02:41,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ca98aa53e72d2e7fc3ea84eb14452a1a 2023-10-01 16:02:41,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion/bb2dec7154ffd8199d878f1bc69b3fbd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 16:02:41,396 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bb2dec7154ffd8199d878f1bc69b3fbd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64462821, jitterRate=-0.039429113268852234}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 16:02:41,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bb2dec7154ffd8199d878f1bc69b3fbd: 2023-10-01 16:02:41,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca98aa53e72d2e7fc3ea84eb14452a1a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 16:02:41,397 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ca98aa53e72d2e7fc3ea84eb14452a1a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73418179, jitterRate=0.09401611983776093}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 16:02:41,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ca98aa53e72d2e7fc3ea84eb14452a1a: 2023-10-01 16:02:41,397 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd., pid=61, masterSystemTime=1696176161377 2023-10-01 16:02:41,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a., pid=60, masterSystemTime=1696176161376 2023-10-01 16:02:41,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd. 2023-10-01 16:02:41,399 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd. 2023-10-01 16:02:41,400 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=bb2dec7154ffd8199d878f1bc69b3fbd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a. 2023-10-01 16:02:41,400 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696176161399"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696176161399"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696176161399"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696176161399"}]},"ts":"1696176161399"} 2023-10-01 16:02:41,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a. 2023-10-01 16:02:41,400 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=ca98aa53e72d2e7fc3ea84eb14452a1a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,401 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696176161400"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696176161400"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696176161400"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696176161400"}]},"ts":"1696176161400"} 2023-10-01 16:02:41,404 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-10-01 16:02:41,404 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure bb2dec7154ffd8199d878f1bc69b3fbd, server=jenkins-hbase4.apache.org,37191,1696176088973 in 176 msec 2023-10-01 16:02:41,404 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-10-01 16:02:41,404 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure ca98aa53e72d2e7fc3ea84eb14452a1a, server=jenkins-hbase4.apache.org,38419,1696176088917 in 178 msec 2023-10-01 16:02:41,405 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bb2dec7154ffd8199d878f1bc69b3fbd, ASSIGN in 338 msec 2023-10-01 16:02:41,406 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-10-01 16:02:41,406 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca98aa53e72d2e7fc3ea84eb14452a1a, ASSIGN in 338 msec 2023-10-01 16:02:41,407 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 16:02:41,407 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176161407"}]},"ts":"1696176161407"} 2023-10-01 16:02:41,408 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-10-01 16:02:41,411 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 16:02:41,411 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-10-01 16:02:41,413 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37191] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-01 16:02:41,415 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:41,415 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:41,415 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:41,415 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:41,417 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,417 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,417 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 16:02:41,417 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,417 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 16:02:41,417 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 16:02:41,418 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 16:02:41,419 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 407 msec 2023-10-01 16:02:41,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-01 16:02:41,618 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-10-01 16:02:41,621 DEBUG [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,621 DEBUG [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd. 2023-10-01 16:02:41,623 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 16:02:41,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 16:02:41,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696176161635 (current time:1696176161635). 2023-10-01 16:02:41,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 16:02:41,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x1fb0c4f8 to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:02:41,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3afe8e43, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:02:41,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:02:41,646 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51726, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:02:41,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1fb0c4f8 to 127.0.0.1:60886 2023-10-01 16:02:41,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:02:41,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x71964f99 to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:02:41,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6898c257, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:02:41,656 DEBUG [hconnection-0x26dad591-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:02:41,657 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51738, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:02:41,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:02:41,663 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38848, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:02:41,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71964f99 to 127.0.0.1:60886 2023-10-01 16:02:41,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:02:41,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-01 16:02:41,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 16:02:41,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 16:02:41,667 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot, current working dir path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 16:02:41,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 16:02:41,670 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 16:02:41,670 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696176761670 2023-10-01 16:02:41,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 16:02:41,670 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,671 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 16:02:41,671 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 16:02:41,672 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 16:02:41,673 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 16:02:41,673 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-10-01 16:02:41,674 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 16:02:41,675 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696176761675 2023-10-01 16:02:41,683 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,684 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-01 16:02:41,684 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:41,685 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-01 16:02:41,685 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-01 16:02:41,685 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,685 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,686 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:41,686 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:41,686 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:41,686 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:41,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:41,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:41,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:41,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:41,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:41,687 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,687 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,687 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,687 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 16:02:41,687 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,687 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,688 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-01 16:02:41,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-01 16:02:41,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-01 16:02:41,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,688 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 16:02:41,688 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 16:02:41,688 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 16:02:41,688 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,688 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,688 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 16:02:41,688 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 16:02:41,688 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:41,688 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,689 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 16:02:41,689 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 16:02:41,689 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 16:02:41,690 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:41,688 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:41,690 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 16:02:41,691 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 16:02:41,690 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45599,1696176089006' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 16:02:41,691 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37191,1696176088973' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 16:02:41,691 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 16:02:41,691 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 16:02:41,691 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38419,1696176088917' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 16:02:41,692 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,693 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,693 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:41,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:41,695 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,695 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,695 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:41,695 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,695 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:02:41,695 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:02:41,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:41,695 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,695 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:02:41,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:41,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:41,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37191,1696176088973' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-01 16:02:41,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e38fc7d[Count = 1] remaining members to acquire global barrier 2023-10-01 16:02:41,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:41,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:41,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:41,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:41,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:41,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:41,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38419,1696176088917' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-01 16:02:41,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e38fc7d[Count = 0] remaining members to acquire global barrier 2023-10-01 16:02:41,699 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-01 16:02:41,699 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,700 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,700 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,700 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,700 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 16:02:41,700 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 16:02:41,700 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,700 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 16:02:41,700 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 16:02:41,700 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd. 2023-10-01 16:02:41,700 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 16:02:41,700 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd. started... 2023-10-01 16:02:41,700 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45599,1696176089006' in zk 2023-10-01 16:02:41,700 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 16:02:41,701 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 16:02:41,700 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 16:02:41,701 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bb2dec7154ffd8199d878f1bc69b3fbd: 2023-10-01 16:02:41,701 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,701 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 16:02:41,700 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a. 2023-10-01 16:02:41,701 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,701 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a. started... 2023-10-01 16:02:41,701 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 16:02:41,701 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 16:02:41,702 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ca98aa53e72d2e7fc3ea84eb14452a1a: 2023-10-01 16:02:41,702 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,702 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 16:02:41,702 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 16:02:41,709 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 16:02:41,709 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:41,709 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 16:02:41,717 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a. completed. 2023-10-01 16:02:41,717 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a. 2023-10-01 16:02:41,717 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 16:02:41,717 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 16:02:41,717 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,717 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 16:02:41,717 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38419,1696176088917' in zk 2023-10-01 16:02:41,718 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd. completed. 2023-10-01 16:02:41,718 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd. 2023-10-01 16:02:41,718 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 16:02:41,718 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 16:02:41,718 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,718 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 16:02:41,718 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37191,1696176088973' in zk 2023-10-01 16:02:41,719 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 16:02:41,719 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,719 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:41,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,719 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 16:02:41,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:41,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:41,721 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 16:02:41,721 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:41,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:41,721 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,721 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 16:02:41,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:41,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:41,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:41,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:41,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38419,1696176088917': 2023-10-01 16:02:41,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38419,1696176088917' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-01 16:02:41,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:41,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:41,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:41,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:41,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:41,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:41,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:41,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37191,1696176088973': 2023-10-01 16:02:41,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37191,1696176088973' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-01 16:02:41,729 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-01 16:02:41,729 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 16:02:41,729 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 16:02:41,729 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,729 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 16:02:41,730 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,730 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:41,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:41,731 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:41,730 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,730 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,731 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:41,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:41,731 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:41,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,731 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:41,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:41,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:41,732 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:41,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:41,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:41,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:41,732 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:41,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:41,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:41,734 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,735 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,735 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:41,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:41,739 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:41,739 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:41,739 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:41,739 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:41,739 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:41,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:41,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:41,739 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:41,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:41,739 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:41,739 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:41,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:41,740 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,740 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:41,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:41,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:41,740 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:41,740 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,740 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:41,740 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,740 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:41,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 16:02:41,742 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:41,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:41,742 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:41,742 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,742 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,742 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,742 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 16:02:41,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,772 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-01 16:02:41,772 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 16:02:41,772 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,772 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,772 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696176161670Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696176161753 (+83 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696176161753Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696176161753Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696176161756 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696176161765 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696176161772 (+7 ms) 2023-10-01 16:02:41,775 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 16:02:41,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-01 16:02:41,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 16:02:41,776 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 104 msec 2023-10-01 16:02:41,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37191] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 16:02:41,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38419] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 16:02:41,781 DEBUG [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,781 DEBUG [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd. 2023-10-01 16:02:41,782 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 16:02:41,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 16:02:41,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696176161791 (current time:1696176161791). 2023-10-01 16:02:41,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 16:02:41,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x71413b23 to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:02:41,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a038ad0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:02:41,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:02:41,800 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51752, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:02:41,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71413b23 to 127.0.0.1:60886 2023-10-01 16:02:41,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:02:41,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x518c6715 to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:02:41,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@296cc624, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:02:41,808 DEBUG [hconnection-0x1f0f8cd3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:02:41,810 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51768, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:02:41,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:02:41,816 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:02:41,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x518c6715 to 127.0.0.1:60886 2023-10-01 16:02:41,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:02:41,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-01 16:02:41,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 16:02:41,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 16:02:41,820 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot, current working dir path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 16:02:41,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 16:02:41,822 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 16:02:41,823 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696176761823 2023-10-01 16:02:41,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 16:02:41,823 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,824 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 16:02:41,825 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 16:02:41,825 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 16:02:41,826 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 16:02:41,827 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-10-01 16:02:41,828 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 16:02:41,828 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696176761828 2023-10-01 16:02:41,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,837 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-01 16:02:41,837 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:41,838 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-01 16:02:41,838 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-01 16:02:41,838 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,838 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,840 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:41,840 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:41,840 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:41,840 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:41,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:41,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:41,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:41,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:41,840 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,840 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:41,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,840 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,841 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 16:02:41,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,841 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,841 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,841 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-01 16:02:41,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-01 16:02:41,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,841 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 16:02:41,841 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 16:02:41,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-01 16:02:41,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,841 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,842 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,842 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 16:02:41,842 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 16:02:41,842 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:41,842 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 16:02:41,843 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 16:02:41,843 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 16:02:41,843 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37191,1696176088973' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 16:02:41,842 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:41,843 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,844 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 16:02:41,844 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 16:02:41,844 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:41,844 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 16:02:41,845 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 16:02:41,845 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 16:02:41,845 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38419,1696176088917' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 16:02:41,845 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45599,1696176089006' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 16:02:41,846 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,846 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:41,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:41,847 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,847 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,848 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,848 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:02:41,848 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,848 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,849 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:02:41,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:41,849 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,849 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:02:41,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:41,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:41,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:41,851 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37191,1696176088973' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-01 16:02:41,851 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@493ead69[Count = 1] remaining members to acquire global barrier 2023-10-01 16:02:41,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:41,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:41,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:41,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:41,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:41,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:41,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38419,1696176088917' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-01 16:02:41,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@493ead69[Count = 0] remaining members to acquire global barrier 2023-10-01 16:02:41,853 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-01 16:02:41,854 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,855 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,855 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,855 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,855 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 16:02:41,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,855 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 16:02:41,855 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,855 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45599,1696176089006' in zk 2023-10-01 16:02:41,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,855 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 16:02:41,855 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 16:02:41,855 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,855 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 16:02:41,855 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 16:02:41,855 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 16:02:41,855 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a. 2023-10-01 16:02:41,855 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 16:02:41,856 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a. started... 2023-10-01 16:02:41,856 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 16:02:41,856 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd. 2023-10-01 16:02:41,856 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd. started... 2023-10-01 16:02:41,856 INFO [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ca98aa53e72d2e7fc3ea84eb14452a1a 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-10-01 16:02:41,856 INFO [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bb2dec7154ffd8199d878f1bc69b3fbd 1/1 column families, dataSize=65 B heapSize=400 B 2023-10-01 16:02:41,856 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 16:02:41,857 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:41,857 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 16:02:41,874 INFO [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310015003455991df4f789f37ace3ff0c7b48 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310015003455991df4f789f37ace3ff0c7b48 2023-10-01 16:02:41,875 INFO [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310011241df47cc8c42b5b50b53a054662100 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310011241df47cc8c42b5b50b53a054662100 2023-10-01 16:02:41,881 INFO [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion/bb2dec7154ffd8199d878f1bc69b3fbd/.tmp/cf/b01c8e8016474c50aed3a380cac0e3d3 2023-10-01 16:02:41,882 INFO [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca98aa53e72d2e7fc3ea84eb14452a1a/.tmp/cf/7337812973264227aabd6a8b6881a40c 2023-10-01 16:02:41,886 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion/bb2dec7154ffd8199d878f1bc69b3fbd/.tmp/cf/b01c8e8016474c50aed3a380cac0e3d3 as hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion/bb2dec7154ffd8199d878f1bc69b3fbd/cf/b01c8e8016474c50aed3a380cac0e3d3 2023-10-01 16:02:41,887 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca98aa53e72d2e7fc3ea84eb14452a1a/.tmp/cf/7337812973264227aabd6a8b6881a40c as hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca98aa53e72d2e7fc3ea84eb14452a1a/cf/7337812973264227aabd6a8b6881a40c 2023-10-01 16:02:41,892 INFO [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca98aa53e72d2e7fc3ea84eb14452a1a/cf/7337812973264227aabd6a8b6881a40c, entries=49, sequenceid=6, filesize=13.9 K 2023-10-01 16:02:41,893 INFO [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for ca98aa53e72d2e7fc3ea84eb14452a1a in 37ms, sequenceid=6, compaction requested=false 2023-10-01 16:02:41,893 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-01 16:02:41,893 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ca98aa53e72d2e7fc3ea84eb14452a1a: 2023-10-01 16:02:41,893 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,893 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 16:02:41,893 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca98aa53e72d2e7fc3ea84eb14452a1a/cf/7337812973264227aabd6a8b6881a40c] hfiles 2023-10-01 16:02:41,893 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca98aa53e72d2e7fc3ea84eb14452a1a/cf/7337812973264227aabd6a8b6881a40c for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,894 INFO [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion/bb2dec7154ffd8199d878f1bc69b3fbd/cf/b01c8e8016474c50aed3a380cac0e3d3, entries=1, sequenceid=6, filesize=5.1 K 2023-10-01 16:02:41,895 INFO [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for bb2dec7154ffd8199d878f1bc69b3fbd in 39ms, sequenceid=6, compaction requested=false 2023-10-01 16:02:41,897 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bb2dec7154ffd8199d878f1bc69b3fbd: 2023-10-01 16:02:41,897 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,897 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 16:02:41,897 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion/bb2dec7154ffd8199d878f1bc69b3fbd/cf/b01c8e8016474c50aed3a380cac0e3d3] hfiles 2023-10-01 16:02:41,897 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion/bb2dec7154ffd8199d878f1bc69b3fbd/cf/b01c8e8016474c50aed3a380cac0e3d3 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,905 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a. completed. 2023-10-01 16:02:41,905 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a. 2023-10-01 16:02:41,905 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 16:02:41,905 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 16:02:41,905 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,905 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 16:02:41,905 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38419,1696176088917' in zk 2023-10-01 16:02:41,906 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd. completed. 2023-10-01 16:02:41,906 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd. 2023-10-01 16:02:41,906 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 16:02:41,906 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 16:02:41,906 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,906 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 16:02:41,906 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37191,1696176088973' in zk 2023-10-01 16:02:41,907 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,907 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 16:02:41,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:41,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:41,907 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:41,907 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 16:02:41,910 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:41,910 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 16:02:41,910 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:41,910 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 16:02:41,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:41,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:41,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:41,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:41,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38419,1696176088917': 2023-10-01 16:02:41,914 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38419,1696176088917' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-01 16:02:41,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:41,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:41,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:41,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:41,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:41,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:41,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:41,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37191,1696176088973': 2023-10-01 16:02:41,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37191,1696176088973' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-01 16:02:41,917 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-01 16:02:41,917 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 16:02:41,917 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 16:02:41,917 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,917 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 16:02:41,925 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 16:02:41,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-01 16:02:41,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-01 16:02:41,926 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,926 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,926 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,926 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 16:02:41,926 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:41,926 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:41,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:41,926 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:41,926 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:41,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:41,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:41,926 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:41,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:41,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:41,927 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:41,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:41,927 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:41,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:41,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:41,929 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:41,929 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,930 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:41,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:41,933 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:41,933 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:41,933 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:41,933 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,933 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:41,933 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:41,933 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,933 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:41,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:41,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:41,933 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:41,933 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:41,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:41,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:41,934 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:41,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:41,934 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,934 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,935 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,935 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,935 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 16:02:41,935 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:41,935 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:41,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:41,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:41,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:41,935 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:41,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:41,935 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:41,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:41,935 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,935 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,936 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310011241df47cc8c42b5b50b53a054662100, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310015003455991df4f789f37ace3ff0c7b48] mob files 2023-10-01 16:02:41,936 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310011241df47cc8c42b5b50b53a054662100 2023-10-01 16:02:41,936 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310015003455991df4f789f37ace3ff0c7b48 2023-10-01 16:02:41,943 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,967 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-01 16:02:41,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,967 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:41,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696176161823Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696176161943 (+120 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696176161943Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1696176161943Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1696176161947 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696176161957 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696176161967 (+10 ms) 2023-10-01 16:02:41,970 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 16:02:41,971 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 146 msec 2023-10-01 16:02:42,126 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 16:02:42,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-01 16:02:42,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 16:02:42,159 DEBUG [Listener at jenkins-hbase4.apache.org/36093] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 16:02:42,162 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38872, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 16:02:42,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37191] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-01 16:02:42,165 DEBUG [Listener at jenkins-hbase4.apache.org/36093] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 16:02:42,167 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51770, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 16:02:42,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38419] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-01 16:02:42,168 DEBUG [Listener at jenkins-hbase4.apache.org/36093] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 16:02:42,170 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42234, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 16:02:42,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45599] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-01 16:02:42,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-01 16:02:42,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:42,176 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 16:02:42,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-10-01 16:02:42,176 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 16:02:42,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-01 16:02:42,179 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/836fff421ef0d9224b4d864097a51590 2023-10-01 16:02:42,179 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c9eb3db8de9c064b0b63944969317ca 2023-10-01 16:02:42,179 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c9eb3db8de9c064b0b63944969317ca empty. 2023-10-01 16:02:42,179 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/836fff421ef0d9224b4d864097a51590 empty. 2023-10-01 16:02:42,180 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c9eb3db8de9c064b0b63944969317ca 2023-10-01 16:02:42,180 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/836fff421ef0d9224b4d864097a51590 2023-10-01 16:02:42,180 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-01 16:02:42,189 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-10-01 16:02:42,191 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 836fff421ef0d9224b4d864097a51590, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162172.836fff421ef0d9224b4d864097a51590.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp 2023-10-01 16:02:42,191 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8c9eb3db8de9c064b0b63944969317ca, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696176162172.8c9eb3db8de9c064b0b63944969317ca.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp 2023-10-01 16:02:42,199 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696176162172.8c9eb3db8de9c064b0b63944969317ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:02:42,199 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162172.836fff421ef0d9224b4d864097a51590.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:02:42,199 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 8c9eb3db8de9c064b0b63944969317ca, disabling compactions & flushes 2023-10-01 16:02:42,199 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 836fff421ef0d9224b4d864097a51590, disabling compactions & flushes 2023-10-01 16:02:42,200 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696176162172.8c9eb3db8de9c064b0b63944969317ca. 2023-10-01 16:02:42,200 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696176162172.8c9eb3db8de9c064b0b63944969317ca. 2023-10-01 16:02:42,200 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162172.836fff421ef0d9224b4d864097a51590. 2023-10-01 16:02:42,200 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696176162172.8c9eb3db8de9c064b0b63944969317ca. after waiting 0 ms 2023-10-01 16:02:42,200 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696176162172.8c9eb3db8de9c064b0b63944969317ca. 2023-10-01 16:02:42,200 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162172.836fff421ef0d9224b4d864097a51590. 2023-10-01 16:02:42,200 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696176162172.8c9eb3db8de9c064b0b63944969317ca. 2023-10-01 16:02:42,200 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162172.836fff421ef0d9224b4d864097a51590. after waiting 0 ms 2023-10-01 16:02:42,200 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 8c9eb3db8de9c064b0b63944969317ca: 2023-10-01 16:02:42,200 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162172.836fff421ef0d9224b4d864097a51590. 2023-10-01 16:02:42,200 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162172.836fff421ef0d9224b4d864097a51590. 2023-10-01 16:02:42,200 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 836fff421ef0d9224b4d864097a51590: 2023-10-01 16:02:42,202 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 16:02:42,203 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696176162172.8c9eb3db8de9c064b0b63944969317ca.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696176162203"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176162203"}]},"ts":"1696176162203"} 2023-10-01 16:02:42,203 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162172.836fff421ef0d9224b4d864097a51590.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696176162203"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176162203"}]},"ts":"1696176162203"} 2023-10-01 16:02:42,205 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 16:02:42,206 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 16:02:42,206 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176162206"}]},"ts":"1696176162206"} 2023-10-01 16:02:42,208 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-10-01 16:02:42,211 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 16:02:42,212 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 16:02:42,212 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 16:02:42,212 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 16:02:42,212 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 16:02:42,212 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=836fff421ef0d9224b4d864097a51590, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8c9eb3db8de9c064b0b63944969317ca, ASSIGN}] 2023-10-01 16:02:42,215 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8c9eb3db8de9c064b0b63944969317ca, ASSIGN 2023-10-01 16:02:42,215 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=836fff421ef0d9224b4d864097a51590, ASSIGN 2023-10-01 16:02:42,216 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=836fff421ef0d9224b4d864097a51590, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37191,1696176088973; forceNewPlan=false, retain=false 2023-10-01 16:02:42,216 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8c9eb3db8de9c064b0b63944969317ca, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45599,1696176089006; forceNewPlan=false, retain=false 2023-10-01 16:02:42,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-01 16:02:42,366 INFO [jenkins-hbase4:42819] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 16:02:42,368 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=836fff421ef0d9224b4d864097a51590, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:42,368 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=8c9eb3db8de9c064b0b63944969317ca, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:42,369 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162172.836fff421ef0d9224b4d864097a51590.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696176162368"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176162368"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176162368"}]},"ts":"1696176162368"} 2023-10-01 16:02:42,369 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696176162172.8c9eb3db8de9c064b0b63944969317ca.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696176162368"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176162368"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176162368"}]},"ts":"1696176162368"} 2023-10-01 16:02:42,370 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 8c9eb3db8de9c064b0b63944969317ca, server=jenkins-hbase4.apache.org,45599,1696176089006}] 2023-10-01 16:02:42,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 836fff421ef0d9224b4d864097a51590, server=jenkins-hbase4.apache.org,37191,1696176088973}] 2023-10-01 16:02:42,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-01 16:02:42,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162172.836fff421ef0d9224b4d864097a51590. 2023-10-01 16:02:42,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1696176162172.8c9eb3db8de9c064b0b63944969317ca. 2023-10-01 16:02:42,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 836fff421ef0d9224b4d864097a51590, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162172.836fff421ef0d9224b4d864097a51590.', STARTKEY => '', ENDKEY => '2'} 2023-10-01 16:02:42,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8c9eb3db8de9c064b0b63944969317ca, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696176162172.8c9eb3db8de9c064b0b63944969317ca.', STARTKEY => '2', ENDKEY => ''} 2023-10-01 16:02:42,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162172.836fff421ef0d9224b4d864097a51590. service=AccessControlService 2023-10-01 16:02:42,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1696176162172.8c9eb3db8de9c064b0b63944969317ca. service=AccessControlService 2023-10-01 16:02:42,526 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 16:02:42,526 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 16:02:42,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 836fff421ef0d9224b4d864097a51590 2023-10-01 16:02:42,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 8c9eb3db8de9c064b0b63944969317ca 2023-10-01 16:02:42,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162172.836fff421ef0d9224b4d864097a51590.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:02:42,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696176162172.8c9eb3db8de9c064b0b63944969317ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:02:42,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 836fff421ef0d9224b4d864097a51590 2023-10-01 16:02:42,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8c9eb3db8de9c064b0b63944969317ca 2023-10-01 16:02:42,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 836fff421ef0d9224b4d864097a51590 2023-10-01 16:02:42,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8c9eb3db8de9c064b0b63944969317ca 2023-10-01 16:02:42,528 INFO [StoreOpener-8c9eb3db8de9c064b0b63944969317ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8c9eb3db8de9c064b0b63944969317ca 2023-10-01 16:02:42,528 INFO [StoreOpener-836fff421ef0d9224b4d864097a51590-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 836fff421ef0d9224b4d864097a51590 2023-10-01 16:02:42,529 DEBUG [StoreOpener-8c9eb3db8de9c064b0b63944969317ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c9eb3db8de9c064b0b63944969317ca/cf 2023-10-01 16:02:42,529 DEBUG [StoreOpener-836fff421ef0d9224b4d864097a51590-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/836fff421ef0d9224b4d864097a51590/cf 2023-10-01 16:02:42,529 DEBUG [StoreOpener-836fff421ef0d9224b4d864097a51590-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/836fff421ef0d9224b4d864097a51590/cf 2023-10-01 16:02:42,529 DEBUG [StoreOpener-8c9eb3db8de9c064b0b63944969317ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c9eb3db8de9c064b0b63944969317ca/cf 2023-10-01 16:02:42,530 INFO [StoreOpener-8c9eb3db8de9c064b0b63944969317ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8c9eb3db8de9c064b0b63944969317ca columnFamilyName cf 2023-10-01 16:02:42,530 INFO [StoreOpener-836fff421ef0d9224b4d864097a51590-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 836fff421ef0d9224b4d864097a51590 columnFamilyName cf 2023-10-01 16:02:42,530 INFO [StoreOpener-8c9eb3db8de9c064b0b63944969317ca-1] regionserver.HStore(310): Store=8c9eb3db8de9c064b0b63944969317ca/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 16:02:42,530 INFO [StoreOpener-836fff421ef0d9224b4d864097a51590-1] regionserver.HStore(310): Store=836fff421ef0d9224b4d864097a51590/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 16:02:42,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/836fff421ef0d9224b4d864097a51590 2023-10-01 16:02:42,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c9eb3db8de9c064b0b63944969317ca 2023-10-01 16:02:42,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/836fff421ef0d9224b4d864097a51590 2023-10-01 16:02:42,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c9eb3db8de9c064b0b63944969317ca 2023-10-01 16:02:42,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 836fff421ef0d9224b4d864097a51590 2023-10-01 16:02:42,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8c9eb3db8de9c064b0b63944969317ca 2023-10-01 16:02:42,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/836fff421ef0d9224b4d864097a51590/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 16:02:42,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c9eb3db8de9c064b0b63944969317ca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 16:02:42,536 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 836fff421ef0d9224b4d864097a51590; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74709647, jitterRate=0.11326049268245697}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 16:02:42,537 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8c9eb3db8de9c064b0b63944969317ca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69752296, jitterRate=0.0393902063369751}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 16:02:42,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 836fff421ef0d9224b4d864097a51590: 2023-10-01 16:02:42,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8c9eb3db8de9c064b0b63944969317ca: 2023-10-01 16:02:42,537 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162172.836fff421ef0d9224b4d864097a51590., pid=70, masterSystemTime=1696176162522 2023-10-01 16:02:42,537 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696176162172.8c9eb3db8de9c064b0b63944969317ca., pid=69, masterSystemTime=1696176162522 2023-10-01 16:02:42,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162172.836fff421ef0d9224b4d864097a51590. 2023-10-01 16:02:42,539 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162172.836fff421ef0d9224b4d864097a51590. 2023-10-01 16:02:42,539 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=836fff421ef0d9224b4d864097a51590, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:42,539 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162172.836fff421ef0d9224b4d864097a51590.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696176162539"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696176162539"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696176162539"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696176162539"}]},"ts":"1696176162539"} 2023-10-01 16:02:42,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696176162172.8c9eb3db8de9c064b0b63944969317ca. 2023-10-01 16:02:42,539 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1696176162172.8c9eb3db8de9c064b0b63944969317ca. 2023-10-01 16:02:42,540 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=8c9eb3db8de9c064b0b63944969317ca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:42,540 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696176162172.8c9eb3db8de9c064b0b63944969317ca.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696176162540"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696176162540"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696176162540"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696176162540"}]},"ts":"1696176162540"} 2023-10-01 16:02:42,542 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-10-01 16:02:42,542 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 836fff421ef0d9224b4d864097a51590, server=jenkins-hbase4.apache.org,37191,1696176088973 in 170 msec 2023-10-01 16:02:42,543 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-10-01 16:02:42,543 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 8c9eb3db8de9c064b0b63944969317ca, server=jenkins-hbase4.apache.org,45599,1696176089006 in 171 msec 2023-10-01 16:02:42,544 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=836fff421ef0d9224b4d864097a51590, ASSIGN in 331 msec 2023-10-01 16:02:42,545 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-10-01 16:02:42,545 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8c9eb3db8de9c064b0b63944969317ca, ASSIGN in 331 msec 2023-10-01 16:02:42,545 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 16:02:42,546 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176162546"}]},"ts":"1696176162546"} 2023-10-01 16:02:42,547 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-10-01 16:02:42,548 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 16:02:42,549 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-10-01 16:02:42,550 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37191] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-01 16:02:42,551 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:42,552 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:42,552 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:42,552 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:42,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 16:02:42,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 16:02:42,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 16:02:42,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-01 16:02:42,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-01 16:02:42,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 16:02:42,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-01 16:02:42,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-01 16:02:42,556 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 381 msec 2023-10-01 16:02:42,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-01 16:02:42,780 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-10-01 16:02:42,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 836fff421ef0d9224b4d864097a51590, 8c9eb3db8de9c064b0b63944969317ca 2023-10-01 16:02:42,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[836fff421ef0d9224b4d864097a51590, 8c9eb3db8de9c064b0b63944969317ca], force=true 2023-10-01 16:02:42,811 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[836fff421ef0d9224b4d864097a51590, 8c9eb3db8de9c064b0b63944969317ca], force=true 2023-10-01 16:02:42,811 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[836fff421ef0d9224b4d864097a51590, 8c9eb3db8de9c064b0b63944969317ca], force=true 2023-10-01 16:02:42,811 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[836fff421ef0d9224b4d864097a51590, 8c9eb3db8de9c064b0b63944969317ca], force=true 2023-10-01 16:02:42,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-01 16:02:42,863 WARN [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42819] assignment.AssignmentManager(1299): Reporting jenkins-hbase4.apache.org,37191,1696176088973 state does not match state=MERGING, location=jenkins-hbase4.apache.org,37191,1696176088973, table=testtb-testExportFileSystemStateWithMergeRegion-1, region=836fff421ef0d9224b4d864097a51590 (time since last update=1696176162861ms) 2023-10-01 16:02:42,863 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=836fff421ef0d9224b4d864097a51590, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8c9eb3db8de9c064b0b63944969317ca, UNASSIGN}] 2023-10-01 16:02:42,865 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=836fff421ef0d9224b4d864097a51590, UNASSIGN 2023-10-01 16:02:42,865 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8c9eb3db8de9c064b0b63944969317ca, UNASSIGN 2023-10-01 16:02:42,866 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=8c9eb3db8de9c064b0b63944969317ca, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:42,866 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=836fff421ef0d9224b4d864097a51590, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:42,866 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162172.836fff421ef0d9224b4d864097a51590.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696176162866"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176162866"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176162866"}]},"ts":"1696176162866"} 2023-10-01 16:02:42,866 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696176162172.8c9eb3db8de9c064b0b63944969317ca.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696176162866"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176162866"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176162866"}]},"ts":"1696176162866"} 2023-10-01 16:02:42,868 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 8c9eb3db8de9c064b0b63944969317ca, server=jenkins-hbase4.apache.org,45599,1696176089006}] 2023-10-01 16:02:42,868 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 836fff421ef0d9224b4d864097a51590, server=jenkins-hbase4.apache.org,37191,1696176088973}] 2023-10-01 16:02:42,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-01 16:02:43,020 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8c9eb3db8de9c064b0b63944969317ca 2023-10-01 16:02:43,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8c9eb3db8de9c064b0b63944969317ca, disabling compactions & flushes 2023-10-01 16:02:43,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696176162172.8c9eb3db8de9c064b0b63944969317ca. 2023-10-01 16:02:43,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696176162172.8c9eb3db8de9c064b0b63944969317ca. 2023-10-01 16:02:43,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696176162172.8c9eb3db8de9c064b0b63944969317ca. after waiting 0 ms 2023-10-01 16:02:43,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696176162172.8c9eb3db8de9c064b0b63944969317ca. 2023-10-01 16:02:43,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 8c9eb3db8de9c064b0b63944969317ca 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-01 16:02:43,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 836fff421ef0d9224b4d864097a51590 2023-10-01 16:02:43,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 836fff421ef0d9224b4d864097a51590, disabling compactions & flushes 2023-10-01 16:02:43,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162172.836fff421ef0d9224b4d864097a51590. 2023-10-01 16:02:43,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162172.836fff421ef0d9224b4d864097a51590. 2023-10-01 16:02:43,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162172.836fff421ef0d9224b4d864097a51590. after waiting 0 ms 2023-10-01 16:02:43,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162172.836fff421ef0d9224b4d864097a51590. 2023-10-01 16:02:43,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 836fff421ef0d9224b4d864097a51590 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-01 16:02:43,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/836fff421ef0d9224b4d864097a51590/.tmp/cf/6aece5fb7f1446d4bf74f5af0dd15ce5 2023-10-01 16:02:43,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c9eb3db8de9c064b0b63944969317ca/.tmp/cf/e73f459cd1434ef5bf43985d0b0003d3 2023-10-01 16:02:43,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c9eb3db8de9c064b0b63944969317ca/.tmp/cf/e73f459cd1434ef5bf43985d0b0003d3 as hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c9eb3db8de9c064b0b63944969317ca/cf/e73f459cd1434ef5bf43985d0b0003d3 2023-10-01 16:02:43,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/836fff421ef0d9224b4d864097a51590/.tmp/cf/6aece5fb7f1446d4bf74f5af0dd15ce5 as hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/836fff421ef0d9224b4d864097a51590/cf/6aece5fb7f1446d4bf74f5af0dd15ce5 2023-10-01 16:02:43,044 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c9eb3db8de9c064b0b63944969317ca/cf/e73f459cd1434ef5bf43985d0b0003d3, entries=1, sequenceid=5, filesize=4.7 K 2023-10-01 16:02:43,044 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/836fff421ef0d9224b4d864097a51590/cf/6aece5fb7f1446d4bf74f5af0dd15ce5, entries=1, sequenceid=5, filesize=4.7 K 2023-10-01 16:02:43,045 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 8c9eb3db8de9c064b0b63944969317ca in 23ms, sequenceid=5, compaction requested=false 2023-10-01 16:02:43,045 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 836fff421ef0d9224b4d864097a51590 in 22ms, sequenceid=5, compaction requested=false 2023-10-01 16:02:43,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-01 16:02:43,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-01 16:02:43,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c9eb3db8de9c064b0b63944969317ca/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-01 16:02:43,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/836fff421ef0d9224b4d864097a51590/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-01 16:02:43,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 16:02:43,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 16:02:43,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696176162172.8c9eb3db8de9c064b0b63944969317ca. 2023-10-01 16:02:43,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162172.836fff421ef0d9224b4d864097a51590. 2023-10-01 16:02:43,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 836fff421ef0d9224b4d864097a51590: 2023-10-01 16:02:43,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8c9eb3db8de9c064b0b63944969317ca: 2023-10-01 16:02:43,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8c9eb3db8de9c064b0b63944969317ca 2023-10-01 16:02:43,057 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=8c9eb3db8de9c064b0b63944969317ca, regionState=CLOSED 2023-10-01 16:02:43,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 836fff421ef0d9224b4d864097a51590 2023-10-01 16:02:43,057 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696176162172.8c9eb3db8de9c064b0b63944969317ca.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696176163057"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176163057"}]},"ts":"1696176163057"} 2023-10-01 16:02:43,058 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=836fff421ef0d9224b4d864097a51590, regionState=CLOSED 2023-10-01 16:02:43,058 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162172.836fff421ef0d9224b4d864097a51590.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696176163058"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176163058"}]},"ts":"1696176163058"} 2023-10-01 16:02:43,060 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=73 2023-10-01 16:02:43,060 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 8c9eb3db8de9c064b0b63944969317ca, server=jenkins-hbase4.apache.org,45599,1696176089006 in 192 msec 2023-10-01 16:02:43,061 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=72 2023-10-01 16:02:43,061 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 836fff421ef0d9224b4d864097a51590, server=jenkins-hbase4.apache.org,37191,1696176088973 in 191 msec 2023-10-01 16:02:43,062 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8c9eb3db8de9c064b0b63944969317ca, UNASSIGN in 197 msec 2023-10-01 16:02:43,063 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-10-01 16:02:43,063 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=836fff421ef0d9224b4d864097a51590, UNASSIGN in 200 msec 2023-10-01 16:02:43,116 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dff776c7d0f221088adeabf5ca76e749/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-10-01 16:02:43,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-01 16:02:43,118 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162172.836fff421ef0d9224b4d864097a51590.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-01 16:02:43,118 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696176162172.8c9eb3db8de9c064b0b63944969317ca.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-01 16:02:43,118 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162173.dff776c7d0f221088adeabf5ca76e749.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-01 16:02:43,169 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dff776c7d0f221088adeabf5ca76e749, ASSIGN}] 2023-10-01 16:02:43,170 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dff776c7d0f221088adeabf5ca76e749, ASSIGN 2023-10-01 16:02:43,170 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dff776c7d0f221088adeabf5ca76e749, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,37191,1696176088973; forceNewPlan=false, retain=false 2023-10-01 16:02:43,321 INFO [jenkins-hbase4:42819] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-01 16:02:43,323 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=dff776c7d0f221088adeabf5ca76e749, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:43,323 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162173.dff776c7d0f221088adeabf5ca76e749.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696176163322"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176163322"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176163322"}]},"ts":"1696176163322"} 2023-10-01 16:02:43,325 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure dff776c7d0f221088adeabf5ca76e749, server=jenkins-hbase4.apache.org,37191,1696176088973}] 2023-10-01 16:02:43,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-01 16:02:43,480 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162173.dff776c7d0f221088adeabf5ca76e749. 2023-10-01 16:02:43,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dff776c7d0f221088adeabf5ca76e749, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162173.dff776c7d0f221088adeabf5ca76e749.', STARTKEY => '', ENDKEY => ''} 2023-10-01 16:02:43,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162173.dff776c7d0f221088adeabf5ca76e749. service=AccessControlService 2023-10-01 16:02:43,480 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 16:02:43,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 dff776c7d0f221088adeabf5ca76e749 2023-10-01 16:02:43,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162173.dff776c7d0f221088adeabf5ca76e749.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:02:43,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dff776c7d0f221088adeabf5ca76e749 2023-10-01 16:02:43,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dff776c7d0f221088adeabf5ca76e749 2023-10-01 16:02:43,481 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dff776c7d0f221088adeabf5ca76e749/.regioninfo 2023-10-01 16:02:43,490 INFO [StoreOpener-dff776c7d0f221088adeabf5ca76e749-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dff776c7d0f221088adeabf5ca76e749 2023-10-01 16:02:43,491 DEBUG [StoreOpener-dff776c7d0f221088adeabf5ca76e749-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dff776c7d0f221088adeabf5ca76e749/cf 2023-10-01 16:02:43,491 DEBUG [StoreOpener-dff776c7d0f221088adeabf5ca76e749-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dff776c7d0f221088adeabf5ca76e749/cf 2023-10-01 16:02:43,491 INFO [StoreOpener-dff776c7d0f221088adeabf5ca76e749-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dff776c7d0f221088adeabf5ca76e749 columnFamilyName cf 2023-10-01 16:02:43,519 DEBUG [StoreOpener-dff776c7d0f221088adeabf5ca76e749-1] regionserver.HStore(539): loaded hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dff776c7d0f221088adeabf5ca76e749/cf/6aece5fb7f1446d4bf74f5af0dd15ce5.836fff421ef0d9224b4d864097a51590->hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/836fff421ef0d9224b4d864097a51590/cf/6aece5fb7f1446d4bf74f5af0dd15ce5-top 2023-10-01 16:02:43,524 DEBUG [StoreOpener-dff776c7d0f221088adeabf5ca76e749-1] regionserver.HStore(539): loaded hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dff776c7d0f221088adeabf5ca76e749/cf/e73f459cd1434ef5bf43985d0b0003d3.8c9eb3db8de9c064b0b63944969317ca->hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c9eb3db8de9c064b0b63944969317ca/cf/e73f459cd1434ef5bf43985d0b0003d3-top 2023-10-01 16:02:43,524 INFO [StoreOpener-dff776c7d0f221088adeabf5ca76e749-1] regionserver.HStore(310): Store=dff776c7d0f221088adeabf5ca76e749/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 16:02:43,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dff776c7d0f221088adeabf5ca76e749 2023-10-01 16:02:43,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dff776c7d0f221088adeabf5ca76e749 2023-10-01 16:02:43,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dff776c7d0f221088adeabf5ca76e749 2023-10-01 16:02:43,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dff776c7d0f221088adeabf5ca76e749; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68266373, jitterRate=0.017248228192329407}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 16:02:43,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dff776c7d0f221088adeabf5ca76e749: 2023-10-01 16:02:43,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162173.dff776c7d0f221088adeabf5ca76e749., pid=77, masterSystemTime=1696176163476 2023-10-01 16:02:43,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162173.dff776c7d0f221088adeabf5ca76e749.,because compaction is disabled. 2023-10-01 16:02:43,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162173.dff776c7d0f221088adeabf5ca76e749. 2023-10-01 16:02:43,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162173.dff776c7d0f221088adeabf5ca76e749. 2023-10-01 16:02:43,533 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=dff776c7d0f221088adeabf5ca76e749, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:43,533 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162173.dff776c7d0f221088adeabf5ca76e749.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696176163533"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696176163533"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696176163533"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696176163533"}]},"ts":"1696176163533"} 2023-10-01 16:02:43,536 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-01 16:02:43,536 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure dff776c7d0f221088adeabf5ca76e749, server=jenkins-hbase4.apache.org,37191,1696176088973 in 209 msec 2023-10-01 16:02:43,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-10-01 16:02:43,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dff776c7d0f221088adeabf5ca76e749, ASSIGN in 367 msec 2023-10-01 16:02:43,539 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[836fff421ef0d9224b4d864097a51590, 8c9eb3db8de9c064b0b63944969317ca], force=true in 733 msec 2023-10-01 16:02:43,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-01 16:02:43,919 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-10-01 16:02:43,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-01 16:02:43,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696176163920 (current time:1696176163920). 2023-10-01 16:02:43,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 16:02:43,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x54c9c16d to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:02:43,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b58c12, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:02:43,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:02:43,930 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51778, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:02:43,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54c9c16d to 127.0.0.1:60886 2023-10-01 16:02:43,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:02:43,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x2522f57f to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:02:43,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f7a8a1f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:02:43,938 DEBUG [hconnection-0x170744fe-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:02:43,940 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51790, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:02:43,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:02:43,946 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38888, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:02:43,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2522f57f to 127.0.0.1:60886 2023-10-01 16:02:43,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:02:43,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-01 16:02:43,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 16:02:43,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-01 16:02:43,950 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot, current working dir path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 16:02:43,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-01 16:02:43,952 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-01 16:02:43,952 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1696176763952 2023-10-01 16:02:43,952 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-01 16:02:43,956 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 16:02:43,956 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 16:02:43,956 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-01 16:02:43,957 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-01 16:02:43,958 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-10-01 16:02:43,959 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-01 16:02:43,959 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1696176763959 2023-10-01 16:02:43,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,968 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-10-01 16:02:43,968 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:43,970 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-10-01 16:02:43,970 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-10-01 16:02:43,970 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,970 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,971 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:43,971 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:43,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:43,971 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:43,971 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:43,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:43,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:43,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:43,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:43,972 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:43,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:43,972 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 16:02:43,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,973 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,973 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-01 16:02:43,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,973 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-01 16:02:43,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-01 16:02:43,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-01 16:02:43,973 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,973 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-01 16:02:43,973 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:43,973 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-01 16:02:43,974 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-01 16:02:43,974 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-01 16:02:43,975 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45599,1696176089006' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-01 16:02:43,973 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-01 16:02:43,975 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,975 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-01 16:02:43,975 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,975 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:43,975 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-01 16:02:43,976 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:43,976 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-01 16:02:43,977 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-01 16:02:43,977 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-01 16:02:43,977 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-01 16:02:43,977 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37191,1696176088973' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-01 16:02:43,977 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38419,1696176088917' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-01 16:02:43,978 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,979 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:43,979 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:43,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:43,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:43,979 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:02:43,979 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,979 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:43,979 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,979 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:02:43,980 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:43,980 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:02:43,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:43,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:43,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:43,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:43,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37191,1696176088973' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-10-01 16:02:43,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@421b9bec[Count = 0] remaining members to acquire global barrier 2023-10-01 16:02:43,981 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-10-01 16:02:43,981 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,983 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,983 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,983 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,984 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-01 16:02:43,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,984 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:43,984 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-01 16:02:43,984 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162173.dff776c7d0f221088adeabf5ca76e749. 2023-10-01 16:02:43,984 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-01 16:02:43,984 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162173.dff776c7d0f221088adeabf5ca76e749. started... 2023-10-01 16:02:43,984 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 16:02:43,984 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 16:02:43,984 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 16:02:43,984 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-01 16:02:43,985 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dff776c7d0f221088adeabf5ca76e749: 2023-10-01 16:02:43,984 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45599,1696176089006' in zk 2023-10-01 16:02:43,985 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-01 16:02:43,985 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,38419,1696176088917' in zk 2023-10-01 16:02:43,985 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162173.dff776c7d0f221088adeabf5ca76e749.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,985 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 16:02:43,985 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dff776c7d0f221088adeabf5ca76e749/cf/6aece5fb7f1446d4bf74f5af0dd15ce5.836fff421ef0d9224b4d864097a51590->hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/836fff421ef0d9224b4d864097a51590/cf/6aece5fb7f1446d4bf74f5af0dd15ce5-top, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dff776c7d0f221088adeabf5ca76e749/cf/e73f459cd1434ef5bf43985d0b0003d3.8c9eb3db8de9c064b0b63944969317ca->hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c9eb3db8de9c064b0b63944969317ca/cf/e73f459cd1434ef5bf43985d0b0003d3-top] hfiles 2023-10-01 16:02:43,985 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dff776c7d0f221088adeabf5ca76e749/cf/6aece5fb7f1446d4bf74f5af0dd15ce5.836fff421ef0d9224b4d864097a51590 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,986 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dff776c7d0f221088adeabf5ca76e749/cf/e73f459cd1434ef5bf43985d0b0003d3.8c9eb3db8de9c064b0b63944969317ca for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:43,987 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-01 16:02:43,987 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:43,987 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-01 16:02:43,987 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-01 16:02:43,988 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:43,988 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-01 16:02:43,997 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162173.dff776c7d0f221088adeabf5ca76e749. completed. 2023-10-01 16:02:43,998 DEBUG [rs(jenkins-hbase4.apache.org,37191,1696176088973)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162173.dff776c7d0f221088adeabf5ca76e749. 2023-10-01 16:02:43,998 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 16:02:43,998 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 16:02:43,998 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:43,998 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-01 16:02:43,998 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37191,1696176088973' in zk 2023-10-01 16:02:44,002 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-01 16:02:44,002 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:44,002 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:44,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:44,002 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-01 16:02:44,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:44,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:44,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:44,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:44,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:44,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:44,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:44,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:44,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:44,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:44,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:44,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,37191,1696176088973': 2023-10-01 16:02:44,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37191,1696176088973' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-10-01 16:02:44,006 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-10-01 16:02:44,006 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 16:02:44,006 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 16:02:44,006 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,006 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 16:02:44,008 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,008 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,008 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:44,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,008 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,008 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,008 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:44,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:44,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:44,008 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:44,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:44,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:44,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:44,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:44,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:44,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:44,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:44,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,012 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:44,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,012 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:44,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:44,013 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:44,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:44,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:44,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:44,014 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:44,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:44,015 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:44,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,015 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:44,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:44,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:44,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:44,017 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:44,018 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,018 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:44,018 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:44,018 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:44,018 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:44,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:44,018 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:44,018 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:44,018 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:44,018 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:44,018 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:44,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:44,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:44,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:44,018 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:44,018 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,018 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:44,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:44,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:44,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:44,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:44,018 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:44,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:44,019 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:44,019 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:44,019 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:44,019 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,019 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,045 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-10-01 16:02:44,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,046 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1696176163953Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696176164018 (+65 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696176164019 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696176164022 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696176164038 (+16 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1696176164045 (+7 ms) 2023-10-01 16:02:44,048 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-01 16:02:44,049 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 92 msec 2023-10-01 16:02:44,056 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 16:02:44,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-01 16:02:44,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 16:02:44,057 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176164057 2023-10-01 16:02:44,057 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44103, tgtDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176164057, rawTgtDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176164057, srcFsUri=hdfs://localhost:44103, srcDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc 2023-10-01 16:02:44,079 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44103, inputRoot=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc 2023-10-01 16:02:44,079 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2017888710_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176164057, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176164057/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,079 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44103, inputRoot=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc, snapshotDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-10-01 16:02:44,088 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176164057/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:44,103 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:44,103 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:44,103 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:44,104 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:44,979 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/hadoop-6860392949401304479.jar 2023-10-01 16:02:44,980 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:44,980 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:45,046 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/hadoop-5472348198558677042.jar 2023-10-01 16:02:45,047 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:45,047 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:45,048 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:45,048 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:45,048 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:45,049 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:45,049 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 16:02:45,050 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 16:02:45,050 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 16:02:45,050 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 16:02:45,051 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 16:02:45,051 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 16:02:45,051 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 16:02:45,052 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 16:02:45,052 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 16:02:45,052 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 16:02:45,053 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:02:45,053 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:02:45,054 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 16:02:45,054 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:02:45,054 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:02:45,055 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 16:02:45,055 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 16:02:45,396 WARN [Listener at jenkins-hbase4.apache.org/36093] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 16:02:45,398 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-10-01 16:02:45,400 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-10-01 16:02:45,556 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 16:02:45,556 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 16:02:45,559 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0004_000001 (auth:SIMPLE) 2023-10-01 16:02:46,281 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 16:02:46,416 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0005_000001 (auth:SIMPLE) 2023-10-01 16:02:50,179 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0005_000001 (auth:SIMPLE) 2023-10-01 16:02:52,388 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0005_000001 (auth:SIMPLE) 2023-10-01 16:02:54,729 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0005_000001 (auth:SIMPLE) 2023-10-01 16:02:56,566 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 16:02:56,569 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 16:02:56,578 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:56,578 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 16:02:56,578 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 16:02:56,579 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1478872176_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:56,579 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-01 16:02:56,579 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-01 16:02:56,579 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1478872176_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176164057/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176164057/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:56,579 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176164057/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-01 16:02:56,580 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176164057/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-01 16:02:56,586 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:56,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:56,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:56,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-01 16:02:56,591 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176176590"}]},"ts":"1696176176590"} 2023-10-01 16:02:56,592 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-10-01 16:02:56,594 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-10-01 16:02:56,594 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dff776c7d0f221088adeabf5ca76e749, UNASSIGN}] 2023-10-01 16:02:56,596 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dff776c7d0f221088adeabf5ca76e749, UNASSIGN 2023-10-01 16:02:56,597 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=dff776c7d0f221088adeabf5ca76e749, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:56,597 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162173.dff776c7d0f221088adeabf5ca76e749.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696176176597"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176176597"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176176597"}]},"ts":"1696176176597"} 2023-10-01 16:02:56,598 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure dff776c7d0f221088adeabf5ca76e749, server=jenkins-hbase4.apache.org,37191,1696176088973}] 2023-10-01 16:02:56,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-01 16:02:56,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dff776c7d0f221088adeabf5ca76e749 2023-10-01 16:02:56,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dff776c7d0f221088adeabf5ca76e749, disabling compactions & flushes 2023-10-01 16:02:56,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162173.dff776c7d0f221088adeabf5ca76e749. 2023-10-01 16:02:56,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162173.dff776c7d0f221088adeabf5ca76e749. 2023-10-01 16:02:56,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162173.dff776c7d0f221088adeabf5ca76e749. after waiting 0 ms 2023-10-01 16:02:56,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162173.dff776c7d0f221088adeabf5ca76e749. 2023-10-01 16:02:56,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dff776c7d0f221088adeabf5ca76e749/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-10-01 16:02:56,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 16:02:56,762 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162173.dff776c7d0f221088adeabf5ca76e749. 2023-10-01 16:02:56,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dff776c7d0f221088adeabf5ca76e749: 2023-10-01 16:02:56,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dff776c7d0f221088adeabf5ca76e749 2023-10-01 16:02:56,764 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=dff776c7d0f221088adeabf5ca76e749, regionState=CLOSED 2023-10-01 16:02:56,764 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162173.dff776c7d0f221088adeabf5ca76e749.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696176176764"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176176764"}]},"ts":"1696176176764"} 2023-10-01 16:02:56,767 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-10-01 16:02:56,767 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure dff776c7d0f221088adeabf5ca76e749, server=jenkins-hbase4.apache.org,37191,1696176088973 in 167 msec 2023-10-01 16:02:56,768 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-10-01 16:02:56,768 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dff776c7d0f221088adeabf5ca76e749, UNASSIGN in 173 msec 2023-10-01 16:02:56,768 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176176768"}]},"ts":"1696176176768"} 2023-10-01 16:02:56,770 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-10-01 16:02:56,771 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-10-01 16:02:56,773 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 186 msec 2023-10-01 16:02:56,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-01 16:02:56,892 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-10-01 16:02:56,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:56,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:56,896 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:56,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:56,897 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:56,898 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37191] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:56,901 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c9eb3db8de9c064b0b63944969317ca 2023-10-01 16:02:56,901 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/836fff421ef0d9224b4d864097a51590 2023-10-01 16:02:56,901 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dff776c7d0f221088adeabf5ca76e749 2023-10-01 16:02:56,901 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:56,901 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:56,901 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:56,901 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:56,902 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-01 16:02:56,902 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-01 16:02:56,902 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-01 16:02:56,902 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-01 16:02:56,903 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:56,903 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:56,903 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:56,903 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:56,903 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:56,903 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:56,903 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c9eb3db8de9c064b0b63944969317ca/cf, FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c9eb3db8de9c064b0b63944969317ca/recovered.edits] 2023-10-01 16:02:56,903 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:56,903 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:56,904 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dff776c7d0f221088adeabf5ca76e749/cf, FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dff776c7d0f221088adeabf5ca76e749/recovered.edits] 2023-10-01 16:02:56,904 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 16:02:56,904 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 16:02:56,904 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 16:02:56,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-01 16:02:56,905 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 16:02:56,908 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c9eb3db8de9c064b0b63944969317ca/cf/e73f459cd1434ef5bf43985d0b0003d3 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c9eb3db8de9c064b0b63944969317ca/cf/e73f459cd1434ef5bf43985d0b0003d3 2023-10-01 16:02:56,908 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dff776c7d0f221088adeabf5ca76e749/cf/6aece5fb7f1446d4bf74f5af0dd15ce5.836fff421ef0d9224b4d864097a51590 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dff776c7d0f221088adeabf5ca76e749/cf/6aece5fb7f1446d4bf74f5af0dd15ce5.836fff421ef0d9224b4d864097a51590 2023-10-01 16:02:56,910 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dff776c7d0f221088adeabf5ca76e749/cf/e73f459cd1434ef5bf43985d0b0003d3.8c9eb3db8de9c064b0b63944969317ca to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dff776c7d0f221088adeabf5ca76e749/cf/e73f459cd1434ef5bf43985d0b0003d3.8c9eb3db8de9c064b0b63944969317ca 2023-10-01 16:02:56,912 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/836fff421ef0d9224b4d864097a51590/cf, FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/836fff421ef0d9224b4d864097a51590/recovered.edits] 2023-10-01 16:02:56,912 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c9eb3db8de9c064b0b63944969317ca/recovered.edits/8.seqid to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c9eb3db8de9c064b0b63944969317ca/recovered.edits/8.seqid 2023-10-01 16:02:56,913 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c9eb3db8de9c064b0b63944969317ca 2023-10-01 16:02:56,914 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dff776c7d0f221088adeabf5ca76e749/recovered.edits/12.seqid to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dff776c7d0f221088adeabf5ca76e749/recovered.edits/12.seqid 2023-10-01 16:02:56,914 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dff776c7d0f221088adeabf5ca76e749 2023-10-01 16:02:56,916 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/836fff421ef0d9224b4d864097a51590/cf/6aece5fb7f1446d4bf74f5af0dd15ce5 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/836fff421ef0d9224b4d864097a51590/cf/6aece5fb7f1446d4bf74f5af0dd15ce5 2023-10-01 16:02:56,919 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/836fff421ef0d9224b4d864097a51590/recovered.edits/8.seqid to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/836fff421ef0d9224b4d864097a51590/recovered.edits/8.seqid 2023-10-01 16:02:56,919 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/836fff421ef0d9224b4d864097a51590 2023-10-01 16:02:56,919 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-01 16:02:56,922 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:56,924 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-10-01 16:02:56,926 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-10-01 16:02:56,927 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:56,927 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-10-01 16:02:56,927 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162173.dff776c7d0f221088adeabf5ca76e749.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696176176927"}]},"ts":"9223372036854775807"} 2023-10-01 16:02:56,929 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-01 16:02:56,929 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => dff776c7d0f221088adeabf5ca76e749, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696176162173.dff776c7d0f221088adeabf5ca76e749.', STARTKEY => '', ENDKEY => ''}] 2023-10-01 16:02:56,929 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-10-01 16:02:56,929 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696176176929"}]},"ts":"9223372036854775807"} 2023-10-01 16:02:56,930 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-10-01 16:02:56,932 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:56,933 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 39 msec 2023-10-01 16:02:57,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-01 16:02:57,006 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-10-01 16:02:57,006 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:57,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:57,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:57,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-01 16:02:57,011 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176177011"}]},"ts":"1696176177011"} 2023-10-01 16:02:57,012 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-10-01 16:02:57,014 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-10-01 16:02:57,014 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bb2dec7154ffd8199d878f1bc69b3fbd, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca98aa53e72d2e7fc3ea84eb14452a1a, UNASSIGN}] 2023-10-01 16:02:57,016 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bb2dec7154ffd8199d878f1bc69b3fbd, UNASSIGN 2023-10-01 16:02:57,016 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca98aa53e72d2e7fc3ea84eb14452a1a, UNASSIGN 2023-10-01 16:02:57,017 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=bb2dec7154ffd8199d878f1bc69b3fbd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:57,017 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=ca98aa53e72d2e7fc3ea84eb14452a1a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:57,017 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696176177017"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176177017"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176177017"}]},"ts":"1696176177017"} 2023-10-01 16:02:57,017 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696176177017"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176177017"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176177017"}]},"ts":"1696176177017"} 2023-10-01 16:02:57,018 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure bb2dec7154ffd8199d878f1bc69b3fbd, server=jenkins-hbase4.apache.org,37191,1696176088973}] 2023-10-01 16:02:57,019 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure ca98aa53e72d2e7fc3ea84eb14452a1a, server=jenkins-hbase4.apache.org,38419,1696176088917}] 2023-10-01 16:02:57,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-01 16:02:57,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ca98aa53e72d2e7fc3ea84eb14452a1a 2023-10-01 16:02:57,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bb2dec7154ffd8199d878f1bc69b3fbd 2023-10-01 16:02:57,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ca98aa53e72d2e7fc3ea84eb14452a1a, disabling compactions & flushes 2023-10-01 16:02:57,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bb2dec7154ffd8199d878f1bc69b3fbd, disabling compactions & flushes 2023-10-01 16:02:57,171 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a. 2023-10-01 16:02:57,171 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd. 2023-10-01 16:02:57,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a. 2023-10-01 16:02:57,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd. 2023-10-01 16:02:57,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a. after waiting 0 ms 2023-10-01 16:02:57,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd. after waiting 0 ms 2023-10-01 16:02:57,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd. 2023-10-01 16:02:57,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a. 2023-10-01 16:02:57,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca98aa53e72d2e7fc3ea84eb14452a1a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 16:02:57,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithMergeRegion/bb2dec7154ffd8199d878f1bc69b3fbd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 16:02:57,182 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 16:02:57,182 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 16:02:57,182 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd. 2023-10-01 16:02:57,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bb2dec7154ffd8199d878f1bc69b3fbd: 2023-10-01 16:02:57,183 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a. 2023-10-01 16:02:57,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ca98aa53e72d2e7fc3ea84eb14452a1a: 2023-10-01 16:02:57,185 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ca98aa53e72d2e7fc3ea84eb14452a1a 2023-10-01 16:02:57,185 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=ca98aa53e72d2e7fc3ea84eb14452a1a, regionState=CLOSED 2023-10-01 16:02:57,185 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696176177185"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176177185"}]},"ts":"1696176177185"} 2023-10-01 16:02:57,185 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bb2dec7154ffd8199d878f1bc69b3fbd 2023-10-01 16:02:57,186 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=bb2dec7154ffd8199d878f1bc69b3fbd, regionState=CLOSED 2023-10-01 16:02:57,186 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696176177186"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176177186"}]},"ts":"1696176177186"} 2023-10-01 16:02:57,188 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-10-01 16:02:57,188 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure ca98aa53e72d2e7fc3ea84eb14452a1a, server=jenkins-hbase4.apache.org,38419,1696176088917 in 168 msec 2023-10-01 16:02:57,189 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-10-01 16:02:57,189 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure bb2dec7154ffd8199d878f1bc69b3fbd, server=jenkins-hbase4.apache.org,37191,1696176088973 in 169 msec 2023-10-01 16:02:57,189 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca98aa53e72d2e7fc3ea84eb14452a1a, UNASSIGN in 174 msec 2023-10-01 16:02:57,190 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-10-01 16:02:57,190 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bb2dec7154ffd8199d878f1bc69b3fbd, UNASSIGN in 175 msec 2023-10-01 16:02:57,191 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176177191"}]},"ts":"1696176177191"} 2023-10-01 16:02:57,192 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-10-01 16:02:57,195 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-10-01 16:02:57,196 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 188 msec 2023-10-01 16:02:57,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-01 16:02:57,313 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-10-01 16:02:57,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:57,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:57,316 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:57,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:57,317 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:57,318 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37191] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:57,320 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:57,320 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:57,320 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:57,320 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:57,321 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-01 16:02:57,321 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-01 16:02:57,321 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-01 16:02:57,321 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-01 16:02:57,321 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bb2dec7154ffd8199d878f1bc69b3fbd 2023-10-01 16:02:57,321 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca98aa53e72d2e7fc3ea84eb14452a1a 2023-10-01 16:02:57,322 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:57,322 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:57,322 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:57,322 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:57,322 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:57,322 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:57,322 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:57,322 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:57,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-01 16:02:57,324 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bb2dec7154ffd8199d878f1bc69b3fbd/cf, FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bb2dec7154ffd8199d878f1bc69b3fbd/recovered.edits] 2023-10-01 16:02:57,324 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca98aa53e72d2e7fc3ea84eb14452a1a/cf, FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca98aa53e72d2e7fc3ea84eb14452a1a/recovered.edits] 2023-10-01 16:02:57,327 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bb2dec7154ffd8199d878f1bc69b3fbd/cf/b01c8e8016474c50aed3a380cac0e3d3 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/bb2dec7154ffd8199d878f1bc69b3fbd/cf/b01c8e8016474c50aed3a380cac0e3d3 2023-10-01 16:02:57,328 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca98aa53e72d2e7fc3ea84eb14452a1a/cf/7337812973264227aabd6a8b6881a40c to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca98aa53e72d2e7fc3ea84eb14452a1a/cf/7337812973264227aabd6a8b6881a40c 2023-10-01 16:02:57,330 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bb2dec7154ffd8199d878f1bc69b3fbd/recovered.edits/9.seqid to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/bb2dec7154ffd8199d878f1bc69b3fbd/recovered.edits/9.seqid 2023-10-01 16:02:57,330 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca98aa53e72d2e7fc3ea84eb14452a1a/recovered.edits/9.seqid to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca98aa53e72d2e7fc3ea84eb14452a1a/recovered.edits/9.seqid 2023-10-01 16:02:57,331 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bb2dec7154ffd8199d878f1bc69b3fbd 2023-10-01 16:02:57,331 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca98aa53e72d2e7fc3ea84eb14452a1a 2023-10-01 16:02:57,331 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-01 16:02:57,331 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-01 16:02:57,332 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-10-01 16:02:57,335 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310011241df47cc8c42b5b50b53a054662100 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310011241df47cc8c42b5b50b53a054662100 2023-10-01 16:02:57,336 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310015003455991df4f789f37ace3ff0c7b48 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310015003455991df4f789f37ace3ff0c7b48 2023-10-01 16:02:57,336 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-01 16:02:57,338 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:57,340 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-10-01 16:02:57,342 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-10-01 16:02:57,342 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:57,343 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-10-01 16:02:57,343 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696176177343"}]},"ts":"9223372036854775807"} 2023-10-01 16:02:57,343 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696176177343"}]},"ts":"9223372036854775807"} 2023-10-01 16:02:57,344 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 16:02:57,344 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bb2dec7154ffd8199d878f1bc69b3fbd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696176161010.bb2dec7154ffd8199d878f1bc69b3fbd.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ca98aa53e72d2e7fc3ea84eb14452a1a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696176161010.ca98aa53e72d2e7fc3ea84eb14452a1a.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 16:02:57,344 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-10-01 16:02:57,344 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696176177344"}]},"ts":"9223372036854775807"} 2023-10-01 16:02:57,345 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-10-01 16:02:57,348 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:57,349 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 34 msec 2023-10-01 16:02:57,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-01 16:02:57,424 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-10-01 16:02:57,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-01 16:02:57,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:57,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-01 16:02:57,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 16:02:57,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-10-01 16:02:57,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 16:02:57,464 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 748) Potentially hanging thread: hconnection-0x4c068432-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1478872176_17 at /127.0.0.1:35708 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3956 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4c068432-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1478872176_17 at /127.0.0.1:58014 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4c068432-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1478872176_17 at /127.0.0.1:44090 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4c068432-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1040168628_1 at /127.0.0.1:37478 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4c068432-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:37473 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1040168628_1 at /127.0.0.1:53888 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4c068432-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=902 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=221 (was 196) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=1402 (was 1371) - AvailableMemoryMB LEAK? - 2023-10-01 16:02:57,464 WARN [Listener at jenkins-hbase4.apache.org/36093] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-10-01 16:02:57,483 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=221, ProcessCount=168, AvailableMemoryMB=1401 2023-10-01 16:02:57,483 WARN [Listener at jenkins-hbase4.apache.org/36093] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-10-01 16:02:57,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 16:02:57,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 16:02:57,487 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 16:02:57,487 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-10-01 16:02:57,487 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 16:02:57,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-01 16:02:57,490 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testEmptyExportFileSystemState/e51054ed3021a09ea6984141432c6b8f 2023-10-01 16:02:57,490 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testEmptyExportFileSystemState/e09eab27fdfb2862aedd5fc4830cfde7 2023-10-01 16:02:57,490 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testEmptyExportFileSystemState/e51054ed3021a09ea6984141432c6b8f empty. 2023-10-01 16:02:57,490 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testEmptyExportFileSystemState/e09eab27fdfb2862aedd5fc4830cfde7 empty. 2023-10-01 16:02:57,491 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testEmptyExportFileSystemState/e51054ed3021a09ea6984141432c6b8f 2023-10-01 16:02:57,491 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testEmptyExportFileSystemState/e09eab27fdfb2862aedd5fc4830cfde7 2023-10-01 16:02:57,491 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-01 16:02:57,500 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-01 16:02:57,501 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => e51054ed3021a09ea6984141432c6b8f, NAME => 'testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp 2023-10-01 16:02:57,501 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => e09eab27fdfb2862aedd5fc4830cfde7, NAME => 'testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp 2023-10-01 16:02:57,508 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:02:57,508 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing e51054ed3021a09ea6984141432c6b8f, disabling compactions & flushes 2023-10-01 16:02:57,508 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f. 2023-10-01 16:02:57,508 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f. 2023-10-01 16:02:57,508 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f. after waiting 0 ms 2023-10-01 16:02:57,508 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f. 2023-10-01 16:02:57,508 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:02:57,508 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f. 2023-10-01 16:02:57,508 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing e09eab27fdfb2862aedd5fc4830cfde7, disabling compactions & flushes 2023-10-01 16:02:57,508 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for e51054ed3021a09ea6984141432c6b8f: 2023-10-01 16:02:57,508 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7. 2023-10-01 16:02:57,508 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7. 2023-10-01 16:02:57,509 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7. after waiting 0 ms 2023-10-01 16:02:57,509 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7. 2023-10-01 16:02:57,509 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7. 2023-10-01 16:02:57,509 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for e09eab27fdfb2862aedd5fc4830cfde7: 2023-10-01 16:02:57,510 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 16:02:57,511 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696176177511"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176177511"}]},"ts":"1696176177511"} 2023-10-01 16:02:57,511 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696176177511"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176177511"}]},"ts":"1696176177511"} 2023-10-01 16:02:57,513 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 16:02:57,514 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 16:02:57,514 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176177514"}]},"ts":"1696176177514"} 2023-10-01 16:02:57,515 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-10-01 16:02:57,518 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 16:02:57,519 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 16:02:57,519 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 16:02:57,519 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 16:02:57,519 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 16:02:57,520 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e51054ed3021a09ea6984141432c6b8f, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e09eab27fdfb2862aedd5fc4830cfde7, ASSIGN}] 2023-10-01 16:02:57,522 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e09eab27fdfb2862aedd5fc4830cfde7, ASSIGN 2023-10-01 16:02:57,522 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e51054ed3021a09ea6984141432c6b8f, ASSIGN 2023-10-01 16:02:57,522 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e09eab27fdfb2862aedd5fc4830cfde7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45599,1696176089006; forceNewPlan=false, retain=false 2023-10-01 16:02:57,522 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e51054ed3021a09ea6984141432c6b8f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38419,1696176088917; forceNewPlan=false, retain=false 2023-10-01 16:02:57,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-01 16:02:57,673 INFO [jenkins-hbase4:42819] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 16:02:57,676 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=e09eab27fdfb2862aedd5fc4830cfde7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:57,676 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=e51054ed3021a09ea6984141432c6b8f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:57,676 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696176177676"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176177676"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176177676"}]},"ts":"1696176177676"} 2023-10-01 16:02:57,676 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696176177676"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176177676"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176177676"}]},"ts":"1696176177676"} 2023-10-01 16:02:57,678 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure e09eab27fdfb2862aedd5fc4830cfde7, server=jenkins-hbase4.apache.org,45599,1696176089006}] 2023-10-01 16:02:57,678 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure e51054ed3021a09ea6984141432c6b8f, server=jenkins-hbase4.apache.org,38419,1696176088917}] 2023-10-01 16:02:57,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-01 16:02:57,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f. 2023-10-01 16:02:57,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7. 2023-10-01 16:02:57,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e51054ed3021a09ea6984141432c6b8f, NAME => 'testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 16:02:57,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e09eab27fdfb2862aedd5fc4830cfde7, NAME => 'testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 16:02:57,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f. service=AccessControlService 2023-10-01 16:02:57,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7. service=AccessControlService 2023-10-01 16:02:57,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 16:02:57,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 16:02:57,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState e51054ed3021a09ea6984141432c6b8f 2023-10-01 16:02:57,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState e09eab27fdfb2862aedd5fc4830cfde7 2023-10-01 16:02:57,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:02:57,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:02:57,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e51054ed3021a09ea6984141432c6b8f 2023-10-01 16:02:57,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e09eab27fdfb2862aedd5fc4830cfde7 2023-10-01 16:02:57,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e51054ed3021a09ea6984141432c6b8f 2023-10-01 16:02:57,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e09eab27fdfb2862aedd5fc4830cfde7 2023-10-01 16:02:57,838 INFO [StoreOpener-e51054ed3021a09ea6984141432c6b8f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e51054ed3021a09ea6984141432c6b8f 2023-10-01 16:02:57,838 INFO [StoreOpener-e09eab27fdfb2862aedd5fc4830cfde7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e09eab27fdfb2862aedd5fc4830cfde7 2023-10-01 16:02:57,839 DEBUG [StoreOpener-e51054ed3021a09ea6984141432c6b8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testEmptyExportFileSystemState/e51054ed3021a09ea6984141432c6b8f/cf 2023-10-01 16:02:57,839 DEBUG [StoreOpener-e51054ed3021a09ea6984141432c6b8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testEmptyExportFileSystemState/e51054ed3021a09ea6984141432c6b8f/cf 2023-10-01 16:02:57,839 DEBUG [StoreOpener-e09eab27fdfb2862aedd5fc4830cfde7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testEmptyExportFileSystemState/e09eab27fdfb2862aedd5fc4830cfde7/cf 2023-10-01 16:02:57,839 DEBUG [StoreOpener-e09eab27fdfb2862aedd5fc4830cfde7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testEmptyExportFileSystemState/e09eab27fdfb2862aedd5fc4830cfde7/cf 2023-10-01 16:02:57,840 INFO [StoreOpener-e09eab27fdfb2862aedd5fc4830cfde7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e09eab27fdfb2862aedd5fc4830cfde7 columnFamilyName cf 2023-10-01 16:02:57,840 INFO [StoreOpener-e51054ed3021a09ea6984141432c6b8f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e51054ed3021a09ea6984141432c6b8f columnFamilyName cf 2023-10-01 16:02:57,841 INFO [StoreOpener-e09eab27fdfb2862aedd5fc4830cfde7-1] regionserver.HStore(310): Store=e09eab27fdfb2862aedd5fc4830cfde7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 16:02:57,841 INFO [StoreOpener-e51054ed3021a09ea6984141432c6b8f-1] regionserver.HStore(310): Store=e51054ed3021a09ea6984141432c6b8f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 16:02:57,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testEmptyExportFileSystemState/e09eab27fdfb2862aedd5fc4830cfde7 2023-10-01 16:02:57,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testEmptyExportFileSystemState/e51054ed3021a09ea6984141432c6b8f 2023-10-01 16:02:57,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testEmptyExportFileSystemState/e09eab27fdfb2862aedd5fc4830cfde7 2023-10-01 16:02:57,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testEmptyExportFileSystemState/e51054ed3021a09ea6984141432c6b8f 2023-10-01 16:02:57,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e51054ed3021a09ea6984141432c6b8f 2023-10-01 16:02:57,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e09eab27fdfb2862aedd5fc4830cfde7 2023-10-01 16:02:57,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testEmptyExportFileSystemState/e51054ed3021a09ea6984141432c6b8f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 16:02:57,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testEmptyExportFileSystemState/e09eab27fdfb2862aedd5fc4830cfde7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 16:02:57,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e51054ed3021a09ea6984141432c6b8f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64685170, jitterRate=-0.0361158549785614}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 16:02:57,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e51054ed3021a09ea6984141432c6b8f: 2023-10-01 16:02:57,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e09eab27fdfb2862aedd5fc4830cfde7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69974180, jitterRate=0.04269653558731079}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 16:02:57,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e09eab27fdfb2862aedd5fc4830cfde7: 2023-10-01 16:02:57,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f., pid=94, masterSystemTime=1696176177830 2023-10-01 16:02:57,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7., pid=93, masterSystemTime=1696176177829 2023-10-01 16:02:57,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f. 2023-10-01 16:02:57,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f. 2023-10-01 16:02:57,850 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=e51054ed3021a09ea6984141432c6b8f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:57,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7. 2023-10-01 16:02:57,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7. 2023-10-01 16:02:57,850 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696176177850"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696176177850"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696176177850"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696176177850"}]},"ts":"1696176177850"} 2023-10-01 16:02:57,851 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=e09eab27fdfb2862aedd5fc4830cfde7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:57,851 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696176177851"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696176177851"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696176177851"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696176177851"}]},"ts":"1696176177851"} 2023-10-01 16:02:57,853 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-10-01 16:02:57,853 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure e51054ed3021a09ea6984141432c6b8f, server=jenkins-hbase4.apache.org,38419,1696176088917 in 174 msec 2023-10-01 16:02:57,854 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-10-01 16:02:57,854 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure e09eab27fdfb2862aedd5fc4830cfde7, server=jenkins-hbase4.apache.org,45599,1696176089006 in 175 msec 2023-10-01 16:02:57,854 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e51054ed3021a09ea6984141432c6b8f, ASSIGN in 334 msec 2023-10-01 16:02:57,855 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-10-01 16:02:57,855 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e09eab27fdfb2862aedd5fc4830cfde7, ASSIGN in 335 msec 2023-10-01 16:02:57,856 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 16:02:57,856 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176177856"}]},"ts":"1696176177856"} 2023-10-01 16:02:57,857 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-10-01 16:02:57,859 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 16:02:57,859 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-10-01 16:02:57,861 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37191] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 16:02:57,864 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:57,864 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:57,864 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:57,864 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:02:57,865 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 16:02:57,865 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 16:02:57,865 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 16:02:57,865 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 16:02:57,866 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 381 msec 2023-10-01 16:02:58,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-01 16:02:58,091 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-10-01 16:02:58,093 DEBUG [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-01 16:02:58,094 DEBUG [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f. 2023-10-01 16:02:58,095 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 16:02:58,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 16:02:58,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696176178107 (current time:1696176178107). 2023-10-01 16:02:58,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 16:02:58,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x4c78d674 to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:02:58,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58bfb6ce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:02:58,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:02:58,119 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40414, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:02:58,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c78d674 to 127.0.0.1:60886 2023-10-01 16:02:58,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:02:58,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x51a09c5d to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:02:58,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b613b6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:02:58,128 DEBUG [hconnection-0x7ecdef0f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:02:58,130 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:02:58,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:02:58,136 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50552, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:02:58,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51a09c5d to 127.0.0.1:60886 2023-10-01 16:02:58,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:02:58,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 16:02:58,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 16:02:58,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 16:02:58,140 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot, current working dir path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 16:02:58,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 16:02:58,145 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 16:02:58,145 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696176778145 2023-10-01 16:02:58,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 16:02:58,145 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-01 16:02:58,146 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 16:02:58,147 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 16:02:58,147 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 16:02:58,147 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 16:02:58,148 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-10-01 16:02:58,151 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 16:02:58,152 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696176778152 2023-10-01 16:02:58,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,162 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-10-01 16:02:58,162 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:58,163 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-01 16:02:58,163 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-01 16:02:58,163 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,163 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,169 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:58,169 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:58,169 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:58,169 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:58,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:58,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:58,169 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:58,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:58,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:58,170 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,170 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,170 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 16:02:58,170 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-01 16:02:58,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,171 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 16:02:58,171 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,171 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 16:02:58,171 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:58,172 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 16:02:58,172 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 16:02:58,172 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37191,1696176088973' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 16:02:58,172 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,172 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-01 16:02:58,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-01 16:02:58,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,176 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 16:02:58,176 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 16:02:58,176 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,177 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,177 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 16:02:58,177 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 16:02:58,177 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:58,177 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:58,178 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 16:02:58,179 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 16:02:58,179 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 16:02:58,179 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 16:02:58,179 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45599,1696176089006' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 16:02:58,179 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38419,1696176088917' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 16:02:58,179 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,179 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,179 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:02:58,180 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,181 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,181 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,181 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:58,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:58,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:58,181 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,181 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:02:58,181 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,181 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:02:58,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:58,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:58,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:58,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45599,1696176089006' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-01 16:02:58,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39bf3cf[Count = 1] remaining members to acquire global barrier 2023-10-01 16:02:58,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:58,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:58,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:58,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:58,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:58,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:58,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38419,1696176088917' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-01 16:02:58,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39bf3cf[Count = 0] remaining members to acquire global barrier 2023-10-01 16:02:58,185 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-01 16:02:58,185 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,188 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,188 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,188 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,188 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 16:02:58,188 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,188 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 16:02:58,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,188 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7. 2023-10-01 16:02:58,188 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 16:02:58,188 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 16:02:58,188 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 16:02:58,188 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 16:02:58,188 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 16:02:58,188 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f. 2023-10-01 16:02:58,188 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,188 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 16:02:58,189 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37191,1696176088973' in zk 2023-10-01 16:02:58,188 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7. started... 2023-10-01 16:02:58,189 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 16:02:58,189 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f. started... 2023-10-01 16:02:58,190 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e51054ed3021a09ea6984141432c6b8f: 2023-10-01 16:02:58,190 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e09eab27fdfb2862aedd5fc4830cfde7: 2023-10-01 16:02:58,190 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,190 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,190 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 16:02:58,190 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 16:02:58,190 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 16:02:58,190 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 16:02:58,191 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 16:02:58,191 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:58,191 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 16:02:58,202 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f. completed. 2023-10-01 16:02:58,202 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f. 2023-10-01 16:02:58,202 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 16:02:58,203 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 16:02:58,203 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,203 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 16:02:58,203 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38419,1696176088917' in zk 2023-10-01 16:02:58,203 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7. completed. 2023-10-01 16:02:58,203 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7. 2023-10-01 16:02:58,203 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 16:02:58,203 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 16:02:58,203 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,203 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 16:02:58,203 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45599,1696176089006' in zk 2023-10-01 16:02:58,204 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,204 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 16:02:58,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,204 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:58,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:58,204 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 16:02:58,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:58,207 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,207 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 16:02:58,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:58,207 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:58,207 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 16:02:58,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:58,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:58,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:58,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:58,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,38419,1696176088917': 2023-10-01 16:02:58,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38419,1696176088917' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-01 16:02:58,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:58,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:58,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:58,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:58,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:58,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:58,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:58,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45599,1696176089006': 2023-10-01 16:02:58,214 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45599,1696176089006' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-01 16:02:58,214 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-10-01 16:02:58,214 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 16:02:58,214 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 16:02:58,214 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,214 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 16:02:58,217 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,217 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,217 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,217 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:58,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,217 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:58,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:58,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:58,217 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,217 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:58,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,218 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:58,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:58,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:58,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:58,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:58,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:58,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:58,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:58,218 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:58,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,219 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:58,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:58,220 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:58,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,221 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:58,221 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,225 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,225 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,225 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:58,225 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,225 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:58,225 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:58,225 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:58,225 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:58,225 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:58,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:58,225 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,225 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:58,225 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-01 16:02:58,225 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:58,226 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:58,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:58,225 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:58,227 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,226 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 16:02:58,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:58,227 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:58,227 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:58,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:58,227 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:58,227 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:58,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:58,227 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:58,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:58,227 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 16:02:58,237 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,247 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 16:02:58,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 16:02:58,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-01 16:02:58,248 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 16:02:58,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,257 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-01 16:02:58,257 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,257 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,257 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696176178145Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696176178237 (+92 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696176178237Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1696176178237Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1696176178240 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696176178251 (+11 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696176178257 (+6 ms) 2023-10-01 16:02:58,260 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 16:02:58,262 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 114 msec 2023-10-01 16:02:58,448 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 16:02:58,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 16:02:58,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 16:02:58,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38419] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 16:02:58,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45599] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 16:02:58,455 DEBUG [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-01 16:02:58,455 DEBUG [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f. 2023-10-01 16:02:58,455 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 16:02:58,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 16:02:58,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696176178465 (current time:1696176178465). 2023-10-01 16:02:58,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 16:02:58,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x203a4384 to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:02:58,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35b8ecf7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:02:58,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:02:58,475 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40422, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:02:58,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x203a4384 to 127.0.0.1:60886 2023-10-01 16:02:58,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:02:58,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x05f0f72a to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:02:58,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7724a273, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:02:58,488 DEBUG [hconnection-0x5892734-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:02:58,489 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40424, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:02:58,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:02:58,493 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:02:58,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05f0f72a to 127.0.0.1:60886 2023-10-01 16:02:58,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:02:58,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 16:02:58,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 16:02:58,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 16:02:58,498 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot, current working dir path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 16:02:58,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 16:02:58,500 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 16:02:58,501 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696176778501 2023-10-01 16:02:58,501 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-01 16:02:58,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 16:02:58,502 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 16:02:58,502 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 16:02:58,503 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 16:02:58,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 16:02:58,504 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-10-01 16:02:58,504 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 16:02:58,505 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696176778505 2023-10-01 16:02:58,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,512 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-10-01 16:02:58,512 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:58,513 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-01 16:02:58,513 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-01 16:02:58,514 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,514 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,515 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:58,515 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:58,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:58,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:58,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:58,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:58,515 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,515 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:58,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:58,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:58,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,515 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,515 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,516 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,516 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 16:02:58,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-01 16:02:58,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,516 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 16:02:58,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-01 16:02:58,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,516 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,516 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 16:02:58,516 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 16:02:58,517 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:58,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-01 16:02:58,518 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,518 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 16:02:58,518 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:58,517 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 16:02:58,518 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 16:02:58,519 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 16:02:58,518 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 16:02:58,519 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38419,1696176088917' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 16:02:58,518 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 16:02:58,519 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45599,1696176089006' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 16:02:58,519 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,519 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 16:02:58,519 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:02:58,522 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 16:02:58,522 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 16:02:58,522 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37191,1696176088973' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 16:02:58,523 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,523 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:58,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:58,525 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,525 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:58,525 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,525 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:02:58,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:58,526 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,526 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,526 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:02:58,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,526 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,527 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:02:58,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:58,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:58,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38419,1696176088917' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-01 16:02:58,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ae92cd5[Count = 1] remaining members to acquire global barrier 2023-10-01 16:02:58,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:58,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:58,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:58,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:58,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:58,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:58,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45599,1696176089006' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-01 16:02:58,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ae92cd5[Count = 0] remaining members to acquire global barrier 2023-10-01 16:02:58,529 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-01 16:02:58,529 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,533 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,533 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,533 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,533 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 16:02:58,533 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,533 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 16:02:58,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,533 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 16:02:58,533 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 16:02:58,533 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37191,1696176088973' in zk 2023-10-01 16:02:58,533 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,533 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 16:02:58,533 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 16:02:58,533 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 16:02:58,533 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7. 2023-10-01 16:02:58,533 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 16:02:58,533 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7. started... 2023-10-01 16:02:58,533 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f. 2023-10-01 16:02:58,533 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 16:02:58,533 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f. started... 2023-10-01 16:02:58,534 INFO [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e51054ed3021a09ea6984141432c6b8f 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-10-01 16:02:58,534 INFO [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e09eab27fdfb2862aedd5fc4830cfde7 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-10-01 16:02:58,535 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 16:02:58,535 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:58,535 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 16:02:58,551 INFO [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231001e3d75c62f65e48d29230fc4d3013742e to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231001e3d75c62f65e48d29230fc4d3013742e 2023-10-01 16:02:58,551 INFO [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231001d03a89d0bade4577bb19bf9f0f2586c8 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231001d03a89d0bade4577bb19bf9f0f2586c8 2023-10-01 16:02:58,558 INFO [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testEmptyExportFileSystemState/e09eab27fdfb2862aedd5fc4830cfde7/.tmp/cf/a81668689d524410a375317583df804a 2023-10-01 16:02:58,559 INFO [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testEmptyExportFileSystemState/e51054ed3021a09ea6984141432c6b8f/.tmp/cf/e84d8dd9799a496b9ad44f44b3d95968 2023-10-01 16:02:58,563 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testEmptyExportFileSystemState/e09eab27fdfb2862aedd5fc4830cfde7/.tmp/cf/a81668689d524410a375317583df804a as hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testEmptyExportFileSystemState/e09eab27fdfb2862aedd5fc4830cfde7/cf/a81668689d524410a375317583df804a 2023-10-01 16:02:58,564 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testEmptyExportFileSystemState/e51054ed3021a09ea6984141432c6b8f/.tmp/cf/e84d8dd9799a496b9ad44f44b3d95968 as hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testEmptyExportFileSystemState/e51054ed3021a09ea6984141432c6b8f/cf/e84d8dd9799a496b9ad44f44b3d95968 2023-10-01 16:02:58,568 INFO [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testEmptyExportFileSystemState/e09eab27fdfb2862aedd5fc4830cfde7/cf/a81668689d524410a375317583df804a, entries=44, sequenceid=6, filesize=12.6 K 2023-10-01 16:02:58,568 INFO [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testEmptyExportFileSystemState/e51054ed3021a09ea6984141432c6b8f/cf/e84d8dd9799a496b9ad44f44b3d95968, entries=6, sequenceid=6, filesize=5.9 K 2023-10-01 16:02:58,568 INFO [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for e09eab27fdfb2862aedd5fc4830cfde7 in 34ms, sequenceid=6, compaction requested=false 2023-10-01 16:02:58,569 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-01 16:02:58,569 INFO [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for e51054ed3021a09ea6984141432c6b8f in 35ms, sequenceid=6, compaction requested=false 2023-10-01 16:02:58,569 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-01 16:02:58,571 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e09eab27fdfb2862aedd5fc4830cfde7: 2023-10-01 16:02:58,571 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e51054ed3021a09ea6984141432c6b8f: 2023-10-01 16:02:58,572 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,572 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,572 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 16:02:58,572 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 16:02:58,572 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testEmptyExportFileSystemState/e09eab27fdfb2862aedd5fc4830cfde7/cf/a81668689d524410a375317583df804a] hfiles 2023-10-01 16:02:58,572 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testEmptyExportFileSystemState/e51054ed3021a09ea6984141432c6b8f/cf/e84d8dd9799a496b9ad44f44b3d95968] hfiles 2023-10-01 16:02:58,572 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testEmptyExportFileSystemState/e09eab27fdfb2862aedd5fc4830cfde7/cf/a81668689d524410a375317583df804a for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,572 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testEmptyExportFileSystemState/e51054ed3021a09ea6984141432c6b8f/cf/e84d8dd9799a496b9ad44f44b3d95968 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,581 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7. completed. 2023-10-01 16:02:58,581 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7. 2023-10-01 16:02:58,581 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 16:02:58,581 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 16:02:58,581 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,581 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 16:02:58,581 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45599,1696176089006' in zk 2023-10-01 16:02:58,582 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f. completed. 2023-10-01 16:02:58,582 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f. 2023-10-01 16:02:58,582 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 16:02:58,582 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 16:02:58,582 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,582 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 16:02:58,582 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38419,1696176088917' in zk 2023-10-01 16:02:58,582 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,582 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 16:02:58,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:58,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:58,583 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:58,583 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 16:02:58,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:58,585 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,585 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 16:02:58,585 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:58,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:58,585 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 16:02:58,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:58,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:58,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:58,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45599,1696176089006': 2023-10-01 16:02:58,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45599,1696176089006' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-01 16:02:58,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:58,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:58,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:58,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:58,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:58,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:58,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:58,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,38419,1696176088917': 2023-10-01 16:02:58,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38419,1696176088917' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-01 16:02:58,592 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-10-01 16:02:58,592 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 16:02:58,592 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 16:02:58,592 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,592 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 16:02:58,594 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,594 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,594 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,594 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,594 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:58,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,594 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:58,594 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:58,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:58,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:58,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:02:58,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:02:58,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:58,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:58,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:58,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:58,594 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:02:58,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,595 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:58,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,595 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:02:58,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:58,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,597 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:58,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:02:58,597 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,597 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:58,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,600 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,600 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,600 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:58,600 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,600 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:58,600 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:58,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:58,600 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:58,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:58,600 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:02:58,600 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,600 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:02:58,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:58,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:58,600 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:58,600 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:58,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:58,600 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-01 16:02:58,600 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:02:58,602 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:58,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:58,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:02:58,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:02:58,602 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 16:02:58,601 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:02:58,602 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,602 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:02:58,602 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:02:58,602 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,602 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:02:58,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:02:58,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231001d03a89d0bade4577bb19bf9f0f2586c8, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231001e3d75c62f65e48d29230fc4d3013742e] mob files 2023-10-01 16:02:58,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231001d03a89d0bade4577bb19bf9f0f2586c8 2023-10-01 16:02:58,603 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 16:02:58,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231001e3d75c62f65e48d29230fc4d3013742e 2023-10-01 16:02:58,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 16:02:58,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-01 16:02:58,604 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 16:02:58,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,610 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,630 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,631 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-01 16:02:58,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,631 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696176178501Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696176178609 (+108 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1696176178609Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1696176178609Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1696176178612 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1696176178624 (+12 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696176178631 (+7 ms) 2023-10-01 16:02:58,636 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 16:02:58,638 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 134 msec 2023-10-01 16:02:58,804 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 16:02:58,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 16:02:58,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 16:02:58,805 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176178805 2023-10-01 16:02:58,805 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44103, tgtDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176178805, rawTgtDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176178805, srcFsUri=hdfs://localhost:44103, srcDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc 2023-10-01 16:02:58,827 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44103, inputRoot=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc 2023-10-01 16:02:58,827 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-389958552_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176178805, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176178805/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,827 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44103, inputRoot=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc, snapshotDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-10-01 16:02:58,833 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176178805/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:02:58,851 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:58,852 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:58,852 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:58,853 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:59,724 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/hadoop-8494563131568797108.jar 2023-10-01 16:02:59,725 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:59,725 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:59,791 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/hadoop-7096954760273142001.jar 2023-10-01 16:02:59,792 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:59,792 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:59,792 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:59,793 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:59,793 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:59,793 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 16:02:59,794 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 16:02:59,794 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 16:02:59,794 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 16:02:59,795 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 16:02:59,795 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 16:02:59,796 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 16:02:59,796 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 16:02:59,796 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 16:02:59,796 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 16:02:59,797 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 16:02:59,798 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:02:59,798 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:02:59,799 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 16:02:59,799 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:02:59,799 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:02:59,799 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 16:02:59,800 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 16:03:00,149 WARN [Listener at jenkins-hbase4.apache.org/36093] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 16:03:00,151 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-10-01 16:03:00,928 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 16:03:00,928 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 16:03:00,931 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0005_000001 (auth:SIMPLE) 2023-10-01 16:03:01,567 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0006_000001 (auth:SIMPLE) 2023-10-01 16:03:02,347 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 16:03:05,298 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0006_000001 (auth:SIMPLE) 2023-10-01 16:03:07,499 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 16:03:07,500 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 16:03:07,505 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:03:07,505 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 16:03:07,506 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 16:03:07,506 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1478872176_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:03:07,506 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-01 16:03:07,506 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-01 16:03:07,506 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1478872176_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176178805/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176178805/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:03:07,507 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176178805/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-01 16:03:07,507 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176178805/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-01 16:03:07,512 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-10-01 16:03:07,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-10-01 16:03:07,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 16:03:07,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-01 16:03:07,516 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176187516"}]},"ts":"1696176187516"} 2023-10-01 16:03:07,518 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-10-01 16:03:07,519 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-10-01 16:03:07,520 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e51054ed3021a09ea6984141432c6b8f, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e09eab27fdfb2862aedd5fc4830cfde7, UNASSIGN}] 2023-10-01 16:03:07,522 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e51054ed3021a09ea6984141432c6b8f, UNASSIGN 2023-10-01 16:03:07,522 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e09eab27fdfb2862aedd5fc4830cfde7, UNASSIGN 2023-10-01 16:03:07,522 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=e51054ed3021a09ea6984141432c6b8f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:07,522 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=e09eab27fdfb2862aedd5fc4830cfde7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:07,522 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696176187522"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176187522"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176187522"}]},"ts":"1696176187522"} 2023-10-01 16:03:07,523 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696176187522"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176187522"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176187522"}]},"ts":"1696176187522"} 2023-10-01 16:03:07,524 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure e51054ed3021a09ea6984141432c6b8f, server=jenkins-hbase4.apache.org,38419,1696176088917}] 2023-10-01 16:03:07,524 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure e09eab27fdfb2862aedd5fc4830cfde7, server=jenkins-hbase4.apache.org,45599,1696176089006}] 2023-10-01 16:03:07,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-01 16:03:07,675 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e51054ed3021a09ea6984141432c6b8f 2023-10-01 16:03:07,675 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e09eab27fdfb2862aedd5fc4830cfde7 2023-10-01 16:03:07,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e51054ed3021a09ea6984141432c6b8f, disabling compactions & flushes 2023-10-01 16:03:07,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e09eab27fdfb2862aedd5fc4830cfde7, disabling compactions & flushes 2023-10-01 16:03:07,676 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f. 2023-10-01 16:03:07,676 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7. 2023-10-01 16:03:07,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f. 2023-10-01 16:03:07,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7. 2023-10-01 16:03:07,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f. after waiting 0 ms 2023-10-01 16:03:07,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7. after waiting 0 ms 2023-10-01 16:03:07,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7. 2023-10-01 16:03:07,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f. 2023-10-01 16:03:07,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testEmptyExportFileSystemState/e09eab27fdfb2862aedd5fc4830cfde7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 16:03:07,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testEmptyExportFileSystemState/e51054ed3021a09ea6984141432c6b8f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 16:03:07,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 16:03:07,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 16:03:07,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7. 2023-10-01 16:03:07,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f. 2023-10-01 16:03:07,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e51054ed3021a09ea6984141432c6b8f: 2023-10-01 16:03:07,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e09eab27fdfb2862aedd5fc4830cfde7: 2023-10-01 16:03:07,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e51054ed3021a09ea6984141432c6b8f 2023-10-01 16:03:07,689 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=e51054ed3021a09ea6984141432c6b8f, regionState=CLOSED 2023-10-01 16:03:07,689 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696176187688"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176187688"}]},"ts":"1696176187688"} 2023-10-01 16:03:07,689 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e09eab27fdfb2862aedd5fc4830cfde7 2023-10-01 16:03:07,689 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=e09eab27fdfb2862aedd5fc4830cfde7, regionState=CLOSED 2023-10-01 16:03:07,689 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696176187689"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176187689"}]},"ts":"1696176187689"} 2023-10-01 16:03:07,692 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-10-01 16:03:07,692 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure e51054ed3021a09ea6984141432c6b8f, server=jenkins-hbase4.apache.org,38419,1696176088917 in 167 msec 2023-10-01 16:03:07,693 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-10-01 16:03:07,693 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure e09eab27fdfb2862aedd5fc4830cfde7, server=jenkins-hbase4.apache.org,45599,1696176089006 in 167 msec 2023-10-01 16:03:07,693 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e51054ed3021a09ea6984141432c6b8f, UNASSIGN in 172 msec 2023-10-01 16:03:07,694 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-10-01 16:03:07,694 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e09eab27fdfb2862aedd5fc4830cfde7, UNASSIGN in 173 msec 2023-10-01 16:03:07,695 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176187695"}]},"ts":"1696176187695"} 2023-10-01 16:03:07,696 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-10-01 16:03:07,698 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-10-01 16:03:07,699 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 186 msec 2023-10-01 16:03:07,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-01 16:03:07,818 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-10-01 16:03:07,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-10-01 16:03:07,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 16:03:07,822 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 16:03:07,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-10-01 16:03:07,823 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 16:03:07,825 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37191] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-10-01 16:03:07,828 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testEmptyExportFileSystemState/e51054ed3021a09ea6984141432c6b8f 2023-10-01 16:03:07,828 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testEmptyExportFileSystemState/e09eab27fdfb2862aedd5fc4830cfde7 2023-10-01 16:03:07,828 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 16:03:07,828 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 16:03:07,828 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 16:03:07,828 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 16:03:07,829 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-01 16:03:07,829 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-01 16:03:07,829 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-01 16:03:07,829 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-01 16:03:07,830 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 16:03:07,830 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:03:07,830 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 16:03:07,830 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 16:03:07,830 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:03:07,830 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:03:07,830 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 16:03:07,830 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:03:07,830 DEBUG [HFileArchiver-17] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testEmptyExportFileSystemState/e51054ed3021a09ea6984141432c6b8f/cf, FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testEmptyExportFileSystemState/e51054ed3021a09ea6984141432c6b8f/recovered.edits] 2023-10-01 16:03:07,831 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testEmptyExportFileSystemState/e09eab27fdfb2862aedd5fc4830cfde7/cf, FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testEmptyExportFileSystemState/e09eab27fdfb2862aedd5fc4830cfde7/recovered.edits] 2023-10-01 16:03:07,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-01 16:03:07,835 DEBUG [HFileArchiver-17] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testEmptyExportFileSystemState/e51054ed3021a09ea6984141432c6b8f/cf/e84d8dd9799a496b9ad44f44b3d95968 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testEmptyExportFileSystemState/e51054ed3021a09ea6984141432c6b8f/cf/e84d8dd9799a496b9ad44f44b3d95968 2023-10-01 16:03:07,835 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testEmptyExportFileSystemState/e09eab27fdfb2862aedd5fc4830cfde7/cf/a81668689d524410a375317583df804a to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testEmptyExportFileSystemState/e09eab27fdfb2862aedd5fc4830cfde7/cf/a81668689d524410a375317583df804a 2023-10-01 16:03:07,838 DEBUG [HFileArchiver-17] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testEmptyExportFileSystemState/e51054ed3021a09ea6984141432c6b8f/recovered.edits/9.seqid to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testEmptyExportFileSystemState/e51054ed3021a09ea6984141432c6b8f/recovered.edits/9.seqid 2023-10-01 16:03:07,839 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testEmptyExportFileSystemState/e09eab27fdfb2862aedd5fc4830cfde7/recovered.edits/9.seqid to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testEmptyExportFileSystemState/e09eab27fdfb2862aedd5fc4830cfde7/recovered.edits/9.seqid 2023-10-01 16:03:07,839 DEBUG [HFileArchiver-17] backup.HFileArchiver(596): Deleted hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testEmptyExportFileSystemState/e51054ed3021a09ea6984141432c6b8f 2023-10-01 16:03:07,839 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testEmptyExportFileSystemState/e09eab27fdfb2862aedd5fc4830cfde7 2023-10-01 16:03:07,839 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-01 16:03:07,840 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-01 16:03:07,840 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-10-01 16:03:07,843 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231001d03a89d0bade4577bb19bf9f0f2586c8 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231001d03a89d0bade4577bb19bf9f0f2586c8 2023-10-01 16:03:07,844 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231001e3d75c62f65e48d29230fc4d3013742e to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231001e3d75c62f65e48d29230fc4d3013742e 2023-10-01 16:03:07,845 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-01 16:03:07,847 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 16:03:07,849 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-10-01 16:03:07,851 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-10-01 16:03:07,852 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 16:03:07,852 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-10-01 16:03:07,852 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696176187852"}]},"ts":"9223372036854775807"} 2023-10-01 16:03:07,852 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696176187852"}]},"ts":"9223372036854775807"} 2023-10-01 16:03:07,854 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 16:03:07,854 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e51054ed3021a09ea6984141432c6b8f, NAME => 'testtb-testEmptyExportFileSystemState,,1696176177484.e51054ed3021a09ea6984141432c6b8f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e09eab27fdfb2862aedd5fc4830cfde7, NAME => 'testtb-testEmptyExportFileSystemState,1,1696176177484.e09eab27fdfb2862aedd5fc4830cfde7.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 16:03:07,854 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-10-01 16:03:07,854 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696176187854"}]},"ts":"9223372036854775807"} 2023-10-01 16:03:07,856 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-10-01 16:03:07,857 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 16:03:07,858 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 38 msec 2023-10-01 16:03:07,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-01 16:03:07,932 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-10-01 16:03:07,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-10-01 16:03:07,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 16:03:07,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-10-01 16:03:07,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-10-01 16:03:07,967 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 758) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1051010317_1 at /127.0.0.1:58504 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1478872176_17 at /127.0.0.1:50744 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4c068432-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1051010317_1 at /127.0.0.1:51860 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4c068432-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4c068432-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4c068432-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:42907 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:44095 from appattempt_1696176096868_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1478872176_17 at /127.0.0.1:51884 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4608 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1478872176_17 at /127.0.0.1:37254 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:37449 from appattempt_1696176096868_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=940 (was 902) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=210 (was 221), ProcessCount=168 (was 168), AvailableMemoryMB=1165 (was 1401) 2023-10-01 16:03:07,967 WARN [Listener at jenkins-hbase4.apache.org/36093] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-01 16:03:07,986 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=940, MaxFileDescriptor=60000, SystemLoadAverage=210, ProcessCount=168, AvailableMemoryMB=1165 2023-10-01 16:03:07,986 WARN [Listener at jenkins-hbase4.apache.org/36093] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-01 16:03:07,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 16:03:07,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:07,991 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 16:03:07,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-10-01 16:03:07,991 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 16:03:07,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-01 16:03:07,994 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6ebddaa90de34fe5b495583f2bbb9c9c 2023-10-01 16:03:07,994 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/80f234c71210106a252ab618f31c119f 2023-10-01 16:03:07,994 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6ebddaa90de34fe5b495583f2bbb9c9c empty. 2023-10-01 16:03:07,994 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/80f234c71210106a252ab618f31c119f empty. 2023-10-01 16:03:07,995 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6ebddaa90de34fe5b495583f2bbb9c9c 2023-10-01 16:03:07,995 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/80f234c71210106a252ab618f31c119f 2023-10-01 16:03:07,995 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-01 16:03:08,009 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-10-01 16:03:08,011 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 80f234c71210106a252ab618f31c119f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp 2023-10-01 16:03:08,011 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6ebddaa90de34fe5b495583f2bbb9c9c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp 2023-10-01 16:03:08,028 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:03:08,029 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 80f234c71210106a252ab618f31c119f, disabling compactions & flushes 2023-10-01 16:03:08,029 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f. 2023-10-01 16:03:08,029 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f. 2023-10-01 16:03:08,029 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f. after waiting 0 ms 2023-10-01 16:03:08,029 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f. 2023-10-01 16:03:08,029 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f. 2023-10-01 16:03:08,029 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 80f234c71210106a252ab618f31c119f: 2023-10-01 16:03:08,029 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:03:08,030 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 6ebddaa90de34fe5b495583f2bbb9c9c, disabling compactions & flushes 2023-10-01 16:03:08,030 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c. 2023-10-01 16:03:08,030 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c. 2023-10-01 16:03:08,030 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c. after waiting 0 ms 2023-10-01 16:03:08,030 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c. 2023-10-01 16:03:08,030 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c. 2023-10-01 16:03:08,030 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 6ebddaa90de34fe5b495583f2bbb9c9c: 2023-10-01 16:03:08,032 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 16:03:08,033 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696176188033"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176188033"}]},"ts":"1696176188033"} 2023-10-01 16:03:08,033 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696176188033"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176188033"}]},"ts":"1696176188033"} 2023-10-01 16:03:08,036 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 16:03:08,037 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 16:03:08,037 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176188037"}]},"ts":"1696176188037"} 2023-10-01 16:03:08,038 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-10-01 16:03:08,042 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 16:03:08,044 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 16:03:08,044 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 16:03:08,044 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 16:03:08,044 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 16:03:08,044 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6ebddaa90de34fe5b495583f2bbb9c9c, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=80f234c71210106a252ab618f31c119f, ASSIGN}] 2023-10-01 16:03:08,047 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=80f234c71210106a252ab618f31c119f, ASSIGN 2023-10-01 16:03:08,047 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6ebddaa90de34fe5b495583f2bbb9c9c, ASSIGN 2023-10-01 16:03:08,048 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=80f234c71210106a252ab618f31c119f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38419,1696176088917; forceNewPlan=false, retain=false 2023-10-01 16:03:08,048 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6ebddaa90de34fe5b495583f2bbb9c9c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45599,1696176089006; forceNewPlan=false, retain=false 2023-10-01 16:03:08,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-01 16:03:08,198 INFO [jenkins-hbase4:42819] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 16:03:08,201 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=6ebddaa90de34fe5b495583f2bbb9c9c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,201 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=80f234c71210106a252ab618f31c119f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,201 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696176188201"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176188201"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176188201"}]},"ts":"1696176188201"} 2023-10-01 16:03:08,201 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696176188201"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176188201"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176188201"}]},"ts":"1696176188201"} 2023-10-01 16:03:08,203 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 6ebddaa90de34fe5b495583f2bbb9c9c, server=jenkins-hbase4.apache.org,45599,1696176089006}] 2023-10-01 16:03:08,203 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 80f234c71210106a252ab618f31c119f, server=jenkins-hbase4.apache.org,38419,1696176088917}] 2023-10-01 16:03:08,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-01 16:03:08,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f. 2023-10-01 16:03:08,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c. 2023-10-01 16:03:08,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 80f234c71210106a252ab618f31c119f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 16:03:08,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6ebddaa90de34fe5b495583f2bbb9c9c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 16:03:08,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f. service=AccessControlService 2023-10-01 16:03:08,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c. service=AccessControlService 2023-10-01 16:03:08,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 16:03:08,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 16:03:08,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 80f234c71210106a252ab618f31c119f 2023-10-01 16:03:08,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 6ebddaa90de34fe5b495583f2bbb9c9c 2023-10-01 16:03:08,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:03:08,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 16:03:08,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 80f234c71210106a252ab618f31c119f 2023-10-01 16:03:08,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6ebddaa90de34fe5b495583f2bbb9c9c 2023-10-01 16:03:08,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6ebddaa90de34fe5b495583f2bbb9c9c 2023-10-01 16:03:08,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 80f234c71210106a252ab618f31c119f 2023-10-01 16:03:08,359 INFO [StoreOpener-80f234c71210106a252ab618f31c119f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 80f234c71210106a252ab618f31c119f 2023-10-01 16:03:08,359 INFO [StoreOpener-6ebddaa90de34fe5b495583f2bbb9c9c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6ebddaa90de34fe5b495583f2bbb9c9c 2023-10-01 16:03:08,360 DEBUG [StoreOpener-80f234c71210106a252ab618f31c119f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithSkipTmp/80f234c71210106a252ab618f31c119f/cf 2023-10-01 16:03:08,360 DEBUG [StoreOpener-6ebddaa90de34fe5b495583f2bbb9c9c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithSkipTmp/6ebddaa90de34fe5b495583f2bbb9c9c/cf 2023-10-01 16:03:08,360 DEBUG [StoreOpener-6ebddaa90de34fe5b495583f2bbb9c9c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithSkipTmp/6ebddaa90de34fe5b495583f2bbb9c9c/cf 2023-10-01 16:03:08,360 DEBUG [StoreOpener-80f234c71210106a252ab618f31c119f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithSkipTmp/80f234c71210106a252ab618f31c119f/cf 2023-10-01 16:03:08,361 INFO [StoreOpener-6ebddaa90de34fe5b495583f2bbb9c9c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6ebddaa90de34fe5b495583f2bbb9c9c columnFamilyName cf 2023-10-01 16:03:08,361 INFO [StoreOpener-80f234c71210106a252ab618f31c119f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80f234c71210106a252ab618f31c119f columnFamilyName cf 2023-10-01 16:03:08,362 INFO [StoreOpener-80f234c71210106a252ab618f31c119f-1] regionserver.HStore(310): Store=80f234c71210106a252ab618f31c119f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 16:03:08,362 INFO [StoreOpener-6ebddaa90de34fe5b495583f2bbb9c9c-1] regionserver.HStore(310): Store=6ebddaa90de34fe5b495583f2bbb9c9c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 16:03:08,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithSkipTmp/80f234c71210106a252ab618f31c119f 2023-10-01 16:03:08,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithSkipTmp/6ebddaa90de34fe5b495583f2bbb9c9c 2023-10-01 16:03:08,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithSkipTmp/80f234c71210106a252ab618f31c119f 2023-10-01 16:03:08,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithSkipTmp/6ebddaa90de34fe5b495583f2bbb9c9c 2023-10-01 16:03:08,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6ebddaa90de34fe5b495583f2bbb9c9c 2023-10-01 16:03:08,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 80f234c71210106a252ab618f31c119f 2023-10-01 16:03:08,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithSkipTmp/6ebddaa90de34fe5b495583f2bbb9c9c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 16:03:08,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithSkipTmp/80f234c71210106a252ab618f31c119f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 16:03:08,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6ebddaa90de34fe5b495583f2bbb9c9c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74002214, jitterRate=0.10271891951560974}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 16:03:08,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 80f234c71210106a252ab618f31c119f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74849427, jitterRate=0.115343376994133}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 16:03:08,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6ebddaa90de34fe5b495583f2bbb9c9c: 2023-10-01 16:03:08,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 80f234c71210106a252ab618f31c119f: 2023-10-01 16:03:08,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f., pid=109, masterSystemTime=1696176188354 2023-10-01 16:03:08,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c., pid=108, masterSystemTime=1696176188354 2023-10-01 16:03:08,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f. 2023-10-01 16:03:08,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f. 2023-10-01 16:03:08,370 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=80f234c71210106a252ab618f31c119f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c. 2023-10-01 16:03:08,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c. 2023-10-01 16:03:08,370 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696176188370"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696176188370"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696176188370"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696176188370"}]},"ts":"1696176188370"} 2023-10-01 16:03:08,371 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=6ebddaa90de34fe5b495583f2bbb9c9c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,371 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696176188371"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696176188371"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696176188371"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696176188371"}]},"ts":"1696176188371"} 2023-10-01 16:03:08,373 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-10-01 16:03:08,373 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 80f234c71210106a252ab618f31c119f, server=jenkins-hbase4.apache.org,38419,1696176088917 in 169 msec 2023-10-01 16:03:08,374 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-10-01 16:03:08,374 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 6ebddaa90de34fe5b495583f2bbb9c9c, server=jenkins-hbase4.apache.org,45599,1696176089006 in 169 msec 2023-10-01 16:03:08,374 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=80f234c71210106a252ab618f31c119f, ASSIGN in 329 msec 2023-10-01 16:03:08,375 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-10-01 16:03:08,375 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6ebddaa90de34fe5b495583f2bbb9c9c, ASSIGN in 330 msec 2023-10-01 16:03:08,376 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 16:03:08,376 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176188376"}]},"ts":"1696176188376"} 2023-10-01 16:03:08,377 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-10-01 16:03:08,379 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 16:03:08,379 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-10-01 16:03:08,380 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37191] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-01 16:03:08,381 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:03:08,381 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:03:08,381 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:03:08,382 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:03:08,383 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-01 16:03:08,383 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-01 16:03:08,383 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-01 16:03:08,383 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-01 16:03:08,384 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 395 msec 2023-10-01 16:03:08,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-01 16:03:08,595 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-10-01 16:03:08,597 DEBUG [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,597 DEBUG [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c. 2023-10-01 16:03:08,599 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 16:03:08,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 16:03:08,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696176188609 (current time:1696176188609). 2023-10-01 16:03:08,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 16:03:08,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x0bcf14e1 to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:03:08,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56523ad9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:03:08,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:03:08,620 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42048, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:03:08,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bcf14e1 to 127.0.0.1:60886 2023-10-01 16:03:08,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:03:08,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x21e654d9 to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:03:08,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52fd2418, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:03:08,627 DEBUG [hconnection-0x153e586c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:03:08,630 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42060, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:03:08,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:03:08,639 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38028, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:03:08,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21e654d9 to 127.0.0.1:60886 2023-10-01 16:03:08,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:03:08,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-01 16:03:08,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 16:03:08,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 16:03:08,643 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot, current working dir path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 16:03:08,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 16:03:08,645 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 16:03:08,646 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696176788646 2023-10-01 16:03:08,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 16:03:08,646 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,647 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 16:03:08,647 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 16:03:08,647 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 16:03:08,648 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 16:03:08,649 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-10-01 16:03:08,650 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 16:03:08,650 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696176788650 2023-10-01 16:03:08,659 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,659 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-01 16:03:08,659 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:03:08,660 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-01 16:03:08,660 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-01 16:03:08,660 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,660 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,662 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:03:08,662 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:03:08,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:03:08,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:03:08,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:03:08,662 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:03:08,662 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:03:08,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:03:08,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:03:08,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,663 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,663 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,663 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,663 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,664 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 16:03:08,664 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-01 16:03:08,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,664 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,664 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 16:03:08,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-01 16:03:08,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-01 16:03:08,664 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 16:03:08,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,664 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 16:03:08,664 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,664 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,664 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 16:03:08,664 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 16:03:08,664 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:03:08,664 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,665 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 16:03:08,666 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 16:03:08,666 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45599,1696176089006' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 16:03:08,664 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:03:08,666 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 16:03:08,666 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 16:03:08,666 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 16:03:08,666 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:03:08,666 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38419,1696176088917' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 16:03:08,667 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 16:03:08,667 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 16:03:08,667 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37191,1696176088973' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 16:03:08,673 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,673 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:03:08,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:03:08,673 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,673 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,674 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,674 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,674 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:03:08,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:03:08,674 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,674 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:03:08,674 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,674 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:03:08,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:03:08,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:03:08,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:03:08,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45599,1696176089006' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-01 16:03:08,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16009904[Count = 1] remaining members to acquire global barrier 2023-10-01 16:03:08,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:03:08,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:03:08,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:03:08,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:03:08,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:03:08,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:03:08,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38419,1696176088917' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-01 16:03:08,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16009904[Count = 0] remaining members to acquire global barrier 2023-10-01 16:03:08,677 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-01 16:03:08,677 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,678 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,678 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,678 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,678 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 16:03:08,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,679 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 16:03:08,679 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 16:03:08,679 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f. 2023-10-01 16:03:08,678 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,679 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f. started... 2023-10-01 16:03:08,679 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 16:03:08,679 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 16:03:08,678 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 16:03:08,679 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,679 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 16:03:08,679 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37191,1696176088973' in zk 2023-10-01 16:03:08,681 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 16:03:08,681 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:03:08,681 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 16:03:08,686 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 16:03:08,686 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 80f234c71210106a252ab618f31c119f: 2023-10-01 16:03:08,686 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c. 2023-10-01 16:03:08,686 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 16:03:08,686 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c. started... 2023-10-01 16:03:08,686 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,686 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 16:03:08,686 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6ebddaa90de34fe5b495583f2bbb9c9c: 2023-10-01 16:03:08,686 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 16:03:08,686 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,686 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 16:03:08,686 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 16:03:08,695 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f. completed. 2023-10-01 16:03:08,695 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f. 2023-10-01 16:03:08,695 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 16:03:08,695 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 16:03:08,696 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,696 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 16:03:08,696 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38419,1696176088917' in zk 2023-10-01 16:03:08,697 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c. completed. 2023-10-01 16:03:08,697 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c. 2023-10-01 16:03:08,697 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 16:03:08,697 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 16:03:08,697 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,697 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 16:03:08,697 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45599,1696176089006' in zk 2023-10-01 16:03:08,698 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 16:03:08,698 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,698 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:03:08,698 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 16:03:08,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:03:08,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:03:08,700 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,700 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 16:03:08,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:03:08,700 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:03:08,700 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 16:03:08,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:03:08,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:03:08,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:03:08,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:03:08,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38419,1696176088917': 2023-10-01 16:03:08,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38419,1696176088917' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-01 16:03:08,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:03:08,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:03:08,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:03:08,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:03:08,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:03:08,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:03:08,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:03:08,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45599,1696176089006': 2023-10-01 16:03:08,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45599,1696176089006' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-01 16:03:08,707 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-01 16:03:08,707 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 16:03:08,707 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 16:03:08,707 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,707 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 16:03:08,708 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,708 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:03:08,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:03:08,708 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,708 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,709 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:03:08,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,708 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:03:08,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:03:08,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,709 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:03:08,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:03:08,709 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:03:08,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:03:08,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:03:08,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:03:08,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:03:08,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:03:08,710 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:03:08,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,710 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:03:08,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:03:08,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,711 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:03:08,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:03:08,712 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,712 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,716 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,716 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,716 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:03:08,716 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:03:08,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:03:08,716 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:03:08,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:03:08,716 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:03:08,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:03:08,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:03:08,716 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,716 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:03:08,717 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,716 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:03:08,716 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:03:08,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:03:08,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:03:08,718 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:03:08,716 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:03:08,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:03:08,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 16:03:08,718 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,718 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:03:08,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:03:08,719 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,719 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:03:08,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:03:08,719 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:03:08,719 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,719 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 16:03:08,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,728 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,744 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,744 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-01 16:03:08,744 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,745 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,745 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696176188646Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696176188727 (+81 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696176188727Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696176188727Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696176188730 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696176188738 (+8 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696176188744 (+6 ms) 2023-10-01 16:03:08,747 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 16:03:08,747 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 16:03:08,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-01 16:03:08,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 16:03:08,748 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 100 msec 2023-10-01 16:03:08,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45599] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 16:03:08,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38419] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 16:03:08,753 DEBUG [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,753 DEBUG [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c. 2023-10-01 16:03:08,754 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 16:03:08,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 16:03:08,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696176188762 (current time:1696176188762). 2023-10-01 16:03:08,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 16:03:08,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x3b6d70b9 to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:03:08,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c23ccdf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:03:08,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:03:08,771 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42074, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:03:08,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b6d70b9 to 127.0.0.1:60886 2023-10-01 16:03:08,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:03:08,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(139): Connect 0x6d142c1f to 127.0.0.1:60886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 16:03:08,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3dac71bc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 16:03:08,780 DEBUG [hconnection-0x7fab07e2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:03:08,782 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42088, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:03:08,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 16:03:08,787 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38040, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 16:03:08,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d142c1f to 127.0.0.1:60886 2023-10-01 16:03:08,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:03:08,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-01 16:03:08,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 16:03:08,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 16:03:08,791 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot, current working dir path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 16:03:08,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 16:03:08,794 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 16:03:08,794 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696176788794 2023-10-01 16:03:08,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 16:03:08,794 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,795 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 16:03:08,795 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 16:03:08,796 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 16:03:08,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 16:03:08,798 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-10-01 16:03:08,798 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 16:03:08,799 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696176788799 2023-10-01 16:03:08,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,814 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-01 16:03:08,814 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:03:08,815 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-01 16:03:08,815 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-01 16:03:08,815 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,815 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,817 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:03:08,817 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:03:08,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:03:08,817 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:03:08,817 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:03:08,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:03:08,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:03:08,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:03:08,817 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,817 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:03:08,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,817 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,817 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 16:03:08,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,817 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-01 16:03:08,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-01 16:03:08,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,818 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 16:03:08,818 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 16:03:08,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-01 16:03:08,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,818 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,818 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 16:03:08,818 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 16:03:08,818 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:03:08,818 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,819 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 16:03:08,819 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,819 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 16:03:08,820 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45599,1696176089006' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 16:03:08,819 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 16:03:08,820 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:03:08,820 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 16:03:08,821 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 16:03:08,821 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 16:03:08,821 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 16:03:08,821 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37191,1696176088973' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 16:03:08,821 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 16:03:08,821 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 16:03:08,822 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38419,1696176088917' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 16:03:08,822 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,822 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:03:08,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:03:08,824 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,824 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,824 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:03:08,826 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,826 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:03:08,826 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,826 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:03:08,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:03:08,826 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,826 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 16:03:08,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:03:08,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:03:08,827 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45599,1696176089006' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-01 16:03:08,827 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@85ab4d3[Count = 1] remaining members to acquire global barrier 2023-10-01 16:03:08,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:03:08,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:03:08,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:03:08,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:03:08,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:03:08,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:03:08,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38419,1696176088917' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-01 16:03:08,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@85ab4d3[Count = 0] remaining members to acquire global barrier 2023-10-01 16:03:08,829 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-01 16:03:08,829 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,833 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,833 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,833 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,833 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,834 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 16:03:08,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,834 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 16:03:08,834 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 16:03:08,834 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 16:03:08,834 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 16:03:08,834 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f. 2023-10-01 16:03:08,834 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c. 2023-10-01 16:03:08,834 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 16:03:08,834 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 16:03:08,834 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,834 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 16:03:08,834 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37191,1696176088973' in zk 2023-10-01 16:03:08,834 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c. started... 2023-10-01 16:03:08,834 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f. started... 2023-10-01 16:03:08,834 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 16:03:08,834 INFO [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6ebddaa90de34fe5b495583f2bbb9c9c 1/1 column families, dataSize=132 B heapSize=544 B 2023-10-01 16:03:08,835 INFO [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 80f234c71210106a252ab618f31c119f 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-10-01 16:03:08,836 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 16:03:08,836 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:03:08,836 DEBUG [member: 'jenkins-hbase4.apache.org,37191,1696176088973' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 16:03:08,852 INFO [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231001fcf39b3d2ef1434ebcc7e2f825e3297b to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231001fcf39b3d2ef1434ebcc7e2f825e3297b 2023-10-01 16:03:08,852 INFO [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310010805c559f2ef4576938a961d93aa42e3 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310010805c559f2ef4576938a961d93aa42e3 2023-10-01 16:03:08,865 INFO [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithSkipTmp/80f234c71210106a252ab618f31c119f/.tmp/cf/050468253c184554b076222991fbd049 2023-10-01 16:03:08,865 INFO [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithSkipTmp/6ebddaa90de34fe5b495583f2bbb9c9c/.tmp/cf/b4d53fec4b8941d9ad5b9dcf99d6bc30 2023-10-01 16:03:08,869 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithSkipTmp/80f234c71210106a252ab618f31c119f/.tmp/cf/050468253c184554b076222991fbd049 as hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithSkipTmp/80f234c71210106a252ab618f31c119f/cf/050468253c184554b076222991fbd049 2023-10-01 16:03:08,869 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithSkipTmp/6ebddaa90de34fe5b495583f2bbb9c9c/.tmp/cf/b4d53fec4b8941d9ad5b9dcf99d6bc30 as hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithSkipTmp/6ebddaa90de34fe5b495583f2bbb9c9c/cf/b4d53fec4b8941d9ad5b9dcf99d6bc30 2023-10-01 16:03:08,873 INFO [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithSkipTmp/80f234c71210106a252ab618f31c119f/cf/050468253c184554b076222991fbd049, entries=48, sequenceid=6, filesize=13.5 K 2023-10-01 16:03:08,873 INFO [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithSkipTmp/6ebddaa90de34fe5b495583f2bbb9c9c/cf/b4d53fec4b8941d9ad5b9dcf99d6bc30, entries=2, sequenceid=6, filesize=5.2 K 2023-10-01 16:03:08,874 INFO [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 6ebddaa90de34fe5b495583f2bbb9c9c in 40ms, sequenceid=6, compaction requested=false 2023-10-01 16:03:08,874 INFO [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 80f234c71210106a252ab618f31c119f in 40ms, sequenceid=6, compaction requested=false 2023-10-01 16:03:08,874 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-01 16:03:08,874 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-01 16:03:08,877 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6ebddaa90de34fe5b495583f2bbb9c9c: 2023-10-01 16:03:08,877 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 80f234c71210106a252ab618f31c119f: 2023-10-01 16:03:08,877 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,877 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,877 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 16:03:08,877 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 16:03:08,877 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithSkipTmp/6ebddaa90de34fe5b495583f2bbb9c9c/cf/b4d53fec4b8941d9ad5b9dcf99d6bc30] hfiles 2023-10-01 16:03:08,877 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithSkipTmp/80f234c71210106a252ab618f31c119f/cf/050468253c184554b076222991fbd049] hfiles 2023-10-01 16:03:08,877 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithSkipTmp/80f234c71210106a252ab618f31c119f/cf/050468253c184554b076222991fbd049 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,877 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithSkipTmp/6ebddaa90de34fe5b495583f2bbb9c9c/cf/b4d53fec4b8941d9ad5b9dcf99d6bc30 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,884 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c. completed. 2023-10-01 16:03:08,884 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f. completed. 2023-10-01 16:03:08,884 DEBUG [rs(jenkins-hbase4.apache.org,38419,1696176088917)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f. 2023-10-01 16:03:08,884 DEBUG [rs(jenkins-hbase4.apache.org,45599,1696176089006)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c. 2023-10-01 16:03:08,884 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 16:03:08,884 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 16:03:08,884 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,884 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 16:03:08,884 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38419,1696176088917' in zk 2023-10-01 16:03:08,885 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 16:03:08,885 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 16:03:08,885 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,885 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 16:03:08,885 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45599,1696176089006' in zk 2023-10-01 16:03:08,887 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,887 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 16:03:08,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:03:08,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:03:08,887 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:03:08,887 DEBUG [member: 'jenkins-hbase4.apache.org,38419,1696176088917' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 16:03:08,888 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,888 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 16:03:08,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:03:08,888 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:03:08,889 DEBUG [member: 'jenkins-hbase4.apache.org,45599,1696176089006' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 16:03:08,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:03:08,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:03:08,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:03:08,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:03:08,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38419,1696176088917': 2023-10-01 16:03:08,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38419,1696176088917' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-01 16:03:08,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:03:08,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:03:08,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:03:08,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:03:08,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:03:08,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:03:08,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:03:08,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45599,1696176089006': 2023-10-01 16:03:08,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45599,1696176089006' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-01 16:03:08,895 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-01 16:03:08,895 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 16:03:08,895 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 16:03:08,895 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,896 INFO [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 16:03:08,896 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 16:03:08,897 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,897 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,897 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 16:03:08,897 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 16:03:08,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-01 16:03:08,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,897 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:03:08,897 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:03:08,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-01 16:03:08,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,898 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:03:08,897 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:03:08,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 16:03:08,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:03:08,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:03:08,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:03:08,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:03:08,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:03:08,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:03:08,898 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,899 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 16:03:08,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:03:08,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,900 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:03:08,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 16:03:08,901 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,901 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 16:03:08,901 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:03:08,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,903 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,903 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,903 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:03:08,903 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,903 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:03:08,904 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 16:03:08,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:03:08,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:03:08,904 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:03:08,904 DEBUG [(jenkins-hbase4.apache.org,42819,1696176087651)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 16:03:08,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:03:08,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:03:08,904 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,904 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,905 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,904 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:03:08,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 16:03:08,904 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:03:08,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 16:03:08,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:03:08,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:03:08,905 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,905 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:08,904 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 16:03:08,905 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,905 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 16:03:08,905 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:08,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:03:08,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:03:08,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 16:03:08,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 16:03:08,906 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:03:08,906 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,906 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,906 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310010805c559f2ef4576938a961d93aa42e3, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231001fcf39b3d2ef1434ebcc7e2f825e3297b] mob files 2023-10-01 16:03:08,906 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310010805c559f2ef4576938a961d93aa42e3 2023-10-01 16:03:08,907 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231001fcf39b3d2ef1434ebcc7e2f825e3297b 2023-10-01 16:03:08,913 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,913 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,929 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-01 16:03:08,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,930 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:08,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696176188794Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696176188913 (+119 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696176188913Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1696176188913Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1696176188915 (+2 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696176188922 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696176188929 (+7 ms) 2023-10-01 16:03:08,932 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 16:03:08,933 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 137 msec 2023-10-01 16:03:09,101 DEBUG [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 16:03:09,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-01 16:03:09,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 16:03:09,102 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176189102 2023-10-01 16:03:09,102 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44103, tgtDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176189102, rawTgtDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176189102, srcFsUri=hdfs://localhost:44103, srcDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc 2023-10-01 16:03:09,124 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44103, inputRoot=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc 2023-10-01 16:03:09,124 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_565038181_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176189102, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176189102/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:09,124 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44103, inputRoot=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc, snapshotDir=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-10-01 16:03:09,134 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176189102/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:09,148 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 16:03:09,148 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 16:03:09,149 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 16:03:09,149 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 16:03:10,023 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/hadoop-1049503375240179155.jar 2023-10-01 16:03:10,024 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 16:03:10,024 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 16:03:10,090 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/hadoop-3093329066789972292.jar 2023-10-01 16:03:10,091 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 16:03:10,091 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 16:03:10,091 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 16:03:10,092 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 16:03:10,092 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 16:03:10,093 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 16:03:10,093 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 16:03:10,093 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 16:03:10,094 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 16:03:10,094 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 16:03:10,094 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 16:03:10,095 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 16:03:10,095 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 16:03:10,095 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 16:03:10,096 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 16:03:10,096 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 16:03:10,097 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:03:10,097 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:03:10,098 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 16:03:10,098 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:03:10,098 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 16:03:10,098 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 16:03:10,099 DEBUG [Listener at jenkins-hbase4.apache.org/36093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 16:03:10,450 WARN [Listener at jenkins-hbase4.apache.org/36093] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 16:03:10,452 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-10-01 16:03:10,454 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-10-01 16:03:12,619 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 16:03:12,619 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 16:03:12,621 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0006_000001 (auth:SIMPLE) 2023-10-01 16:03:12,942 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0007_000001 (auth:SIMPLE) 2023-10-01 16:03:13,269 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 16:03:16,649 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0007_000001 (auth:SIMPLE) 2023-10-01 16:03:18,860 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0007_000001 (auth:SIMPLE) 2023-10-01 16:03:21,426 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696176096868_0007_000001 (auth:SIMPLE) 2023-10-01 16:03:22,610 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 16:03:22,610 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 16:03:22,620 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:22,620 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 16:03:22,621 INFO [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 16:03:22,621 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1478872176_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:22,622 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-01 16:03:22,622 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-01 16:03:22,622 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1478872176_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176189102/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176189102/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:22,622 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176189102/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-01 16:03:22,622 DEBUG [Listener at jenkins-hbase4.apache.org/36093] snapshot.TestExportSnapshot(367): hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/export-test/export-1696176189102/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-01 16:03:22,628 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:22,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:22,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:22,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-01 16:03:22,631 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176202631"}]},"ts":"1696176202631"} 2023-10-01 16:03:22,633 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-10-01 16:03:22,634 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-10-01 16:03:22,635 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6ebddaa90de34fe5b495583f2bbb9c9c, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=80f234c71210106a252ab618f31c119f, UNASSIGN}] 2023-10-01 16:03:22,636 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6ebddaa90de34fe5b495583f2bbb9c9c, UNASSIGN 2023-10-01 16:03:22,636 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=80f234c71210106a252ab618f31c119f, UNASSIGN 2023-10-01 16:03:22,637 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=80f234c71210106a252ab618f31c119f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:22,637 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=6ebddaa90de34fe5b495583f2bbb9c9c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:22,637 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696176202637"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176202637"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176202637"}]},"ts":"1696176202637"} 2023-10-01 16:03:22,637 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696176202637"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696176202637"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696176202637"}]},"ts":"1696176202637"} 2023-10-01 16:03:22,638 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 6ebddaa90de34fe5b495583f2bbb9c9c, server=jenkins-hbase4.apache.org,45599,1696176089006}] 2023-10-01 16:03:22,639 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 80f234c71210106a252ab618f31c119f, server=jenkins-hbase4.apache.org,38419,1696176088917}] 2023-10-01 16:03:22,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-01 16:03:22,790 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 80f234c71210106a252ab618f31c119f 2023-10-01 16:03:22,790 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6ebddaa90de34fe5b495583f2bbb9c9c 2023-10-01 16:03:22,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 80f234c71210106a252ab618f31c119f, disabling compactions & flushes 2023-10-01 16:03:22,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6ebddaa90de34fe5b495583f2bbb9c9c, disabling compactions & flushes 2023-10-01 16:03:22,790 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f. 2023-10-01 16:03:22,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f. 2023-10-01 16:03:22,790 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c. 2023-10-01 16:03:22,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f. after waiting 0 ms 2023-10-01 16:03:22,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f. 2023-10-01 16:03:22,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c. 2023-10-01 16:03:22,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c. after waiting 0 ms 2023-10-01 16:03:22,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c. 2023-10-01 16:03:22,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithSkipTmp/6ebddaa90de34fe5b495583f2bbb9c9c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 16:03:22,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/default/testtb-testExportFileSystemStateWithSkipTmp/80f234c71210106a252ab618f31c119f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 16:03:22,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 16:03:22,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c. 2023-10-01 16:03:22,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6ebddaa90de34fe5b495583f2bbb9c9c: 2023-10-01 16:03:22,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 16:03:22,811 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f. 2023-10-01 16:03:22,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 80f234c71210106a252ab618f31c119f: 2023-10-01 16:03:22,812 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6ebddaa90de34fe5b495583f2bbb9c9c 2023-10-01 16:03:22,813 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=6ebddaa90de34fe5b495583f2bbb9c9c, regionState=CLOSED 2023-10-01 16:03:22,813 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 80f234c71210106a252ab618f31c119f 2023-10-01 16:03:22,813 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696176202813"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176202813"}]},"ts":"1696176202813"} 2023-10-01 16:03:22,813 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=80f234c71210106a252ab618f31c119f, regionState=CLOSED 2023-10-01 16:03:22,813 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696176202813"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696176202813"}]},"ts":"1696176202813"} 2023-10-01 16:03:22,816 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-10-01 16:03:22,816 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 6ebddaa90de34fe5b495583f2bbb9c9c, server=jenkins-hbase4.apache.org,45599,1696176089006 in 176 msec 2023-10-01 16:03:22,817 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-10-01 16:03:22,817 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6ebddaa90de34fe5b495583f2bbb9c9c, UNASSIGN in 181 msec 2023-10-01 16:03:22,817 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 80f234c71210106a252ab618f31c119f, server=jenkins-hbase4.apache.org,38419,1696176088917 in 176 msec 2023-10-01 16:03:22,819 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-10-01 16:03:22,819 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=80f234c71210106a252ab618f31c119f, UNASSIGN in 182 msec 2023-10-01 16:03:22,819 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696176202819"}]},"ts":"1696176202819"} 2023-10-01 16:03:22,820 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-10-01 16:03:22,821 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-10-01 16:03:22,826 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 194 msec 2023-10-01 16:03:22,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-01 16:03:22,933 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-10-01 16:03:22,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:22,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:22,937 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:22,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:22,937 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:22,939 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37191] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:22,941 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6ebddaa90de34fe5b495583f2bbb9c9c 2023-10-01 16:03:22,941 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/80f234c71210106a252ab618f31c119f 2023-10-01 16:03:22,942 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:22,942 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:22,942 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:22,942 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:22,942 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-01 16:03:22,942 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-01 16:03:22,942 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-01 16:03:22,942 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-01 16:03:22,943 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:22,943 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:22,943 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:03:22,943 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:22,943 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:22,943 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:03:22,943 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:03:22,944 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 16:03:22,944 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6ebddaa90de34fe5b495583f2bbb9c9c/cf, FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6ebddaa90de34fe5b495583f2bbb9c9c/recovered.edits] 2023-10-01 16:03:22,944 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/80f234c71210106a252ab618f31c119f/cf, FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/80f234c71210106a252ab618f31c119f/recovered.edits] 2023-10-01 16:03:22,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-01 16:03:22,947 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6ebddaa90de34fe5b495583f2bbb9c9c/cf/b4d53fec4b8941d9ad5b9dcf99d6bc30 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6ebddaa90de34fe5b495583f2bbb9c9c/cf/b4d53fec4b8941d9ad5b9dcf99d6bc30 2023-10-01 16:03:22,948 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/80f234c71210106a252ab618f31c119f/cf/050468253c184554b076222991fbd049 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/80f234c71210106a252ab618f31c119f/cf/050468253c184554b076222991fbd049 2023-10-01 16:03:22,950 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6ebddaa90de34fe5b495583f2bbb9c9c/recovered.edits/9.seqid to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6ebddaa90de34fe5b495583f2bbb9c9c/recovered.edits/9.seqid 2023-10-01 16:03:22,950 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/80f234c71210106a252ab618f31c119f/recovered.edits/9.seqid to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/80f234c71210106a252ab618f31c119f/recovered.edits/9.seqid 2023-10-01 16:03:22,951 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6ebddaa90de34fe5b495583f2bbb9c9c 2023-10-01 16:03:22,951 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/80f234c71210106a252ab618f31c119f 2023-10-01 16:03:22,951 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-01 16:03:22,951 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-01 16:03:22,952 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-10-01 16:03:22,955 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310010805c559f2ef4576938a961d93aa42e3 to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310010805c559f2ef4576938a961d93aa42e3 2023-10-01 16:03:22,956 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231001fcf39b3d2ef1434ebcc7e2f825e3297b to hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231001fcf39b3d2ef1434ebcc7e2f825e3297b 2023-10-01 16:03:22,957 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-01 16:03:22,959 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:22,960 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-10-01 16:03:22,962 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-10-01 16:03:22,963 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:22,963 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-10-01 16:03:22,963 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696176202963"}]},"ts":"9223372036854775807"} 2023-10-01 16:03:22,963 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696176202963"}]},"ts":"9223372036854775807"} 2023-10-01 16:03:22,964 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 16:03:22,964 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6ebddaa90de34fe5b495583f2bbb9c9c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696176187988.6ebddaa90de34fe5b495583f2bbb9c9c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 80f234c71210106a252ab618f31c119f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696176187988.80f234c71210106a252ab618f31c119f.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 16:03:22,965 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-10-01 16:03:22,965 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696176202965"}]},"ts":"9223372036854775807"} 2023-10-01 16:03:22,966 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-10-01 16:03:22,967 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:22,968 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 33 msec 2023-10-01 16:03:23,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-01 16:03:23,045 INFO [Listener at jenkins-hbase4.apache.org/36093] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-10-01 16:03:23,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-01 16:03:23,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:23,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-01 16:03:23,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42819] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 16:03:23,079 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 765), OpenFileDescriptor=909 (was 940), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=200 (was 210), ProcessCount=168 (was 168), AvailableMemoryMB=1131 (was 1165) 2023-10-01 16:03:23,079 WARN [Listener at jenkins-hbase4.apache.org/36093] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-10-01 16:03:23,079 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-10-01 16:03:23,090 INFO [Listener at jenkins-hbase4.apache.org/36093] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-01 16:03:23,200 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1696176096868_0007_01_000001 is : 143 2023-10-01 16:03:28,376 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 16:03:37,211 INFO [Listener at jenkins-hbase4.apache.org/36093] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-01 16:03:51,325 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-01 16:03:51,325 INFO [Listener at jenkins-hbase4.apache.org/36093] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-01 16:03:51,432 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-10-01 16:03:51,441 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-10-01 16:03:51,445 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-01 16:03:51,451 INFO [Listener at jenkins-hbase4.apache.org/36093] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-01 16:03:51,555 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-01 16:03:51,555 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-10-01 16:03:51,555 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-01 16:03:51,555 INFO [Listener at jenkins-hbase4.apache.org/36093] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-01 16:03:51,555 DEBUG [Listener at jenkins-hbase4.apache.org/36093] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21c22958 to 127.0.0.1:60886 2023-10-01 16:03:51,555 DEBUG [Listener at jenkins-hbase4.apache.org/36093] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:03:51,555 DEBUG [Listener at jenkins-hbase4.apache.org/36093] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-01 16:03:51,556 DEBUG [Listener at jenkins-hbase4.apache.org/36093] util.JVMClusterUtil(257): Found active master hash=2032002281, stopped=false 2023-10-01 16:03:51,556 DEBUG [Listener at jenkins-hbase4.apache.org/36093] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 16:03:51,556 DEBUG [Listener at jenkins-hbase4.apache.org/36093] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-01 16:03:51,556 INFO [Listener at jenkins-hbase4.apache.org/36093] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42819,1696176087651 2023-10-01 16:03:51,557 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-01 16:03:51,557 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-01 16:03:51,557 INFO [Listener at jenkins-hbase4.apache.org/36093] procedure2.ProcedureExecutor(628): Stopping 2023-10-01 16:03:51,557 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-01 16:03:51,557 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-01 16:03:51,557 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 16:03:51,558 DEBUG [Listener at jenkins-hbase4.apache.org/36093] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42ac966b to 127.0.0.1:60886 2023-10-01 16:03:51,558 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 16:03:51,558 DEBUG [Listener at jenkins-hbase4.apache.org/36093] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:03:51,558 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 16:03:51,558 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 16:03:51,558 INFO [Listener at jenkins-hbase4.apache.org/36093] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38419,1696176088917' ***** 2023-10-01 16:03:51,558 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 16:03:51,558 DEBUG [Listener at jenkins-hbase4.apache.org/36093] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 16:03:51,558 INFO [Listener at jenkins-hbase4.apache.org/36093] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-01 16:03:51,559 INFO [Listener at jenkins-hbase4.apache.org/36093] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37191,1696176088973' ***** 2023-10-01 16:03:51,559 DEBUG [Listener at jenkins-hbase4.apache.org/36093] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 16:03:51,559 INFO [RS:0;jenkins-hbase4:38419] regionserver.HeapMemoryManager(220): Stopping 2023-10-01 16:03:51,559 INFO [Listener at jenkins-hbase4.apache.org/36093] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-01 16:03:51,559 INFO [Listener at jenkins-hbase4.apache.org/36093] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45599,1696176089006' ***** 2023-10-01 16:03:51,559 INFO [RS:0;jenkins-hbase4:38419] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-01 16:03:51,559 INFO [RS:1;jenkins-hbase4:37191] regionserver.HeapMemoryManager(220): Stopping 2023-10-01 16:03:51,559 INFO [RS:0;jenkins-hbase4:38419] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-01 16:03:51,559 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-01 16:03:51,559 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-01 16:03:51,559 INFO [RS:0;jenkins-hbase4:38419] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:51,559 DEBUG [Listener at jenkins-hbase4.apache.org/36093] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 16:03:51,559 DEBUG [RS:0;jenkins-hbase4:38419] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x798d3354 to 127.0.0.1:60886 2023-10-01 16:03:51,559 INFO [RS:1;jenkins-hbase4:37191] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-01 16:03:51,559 DEBUG [RS:0;jenkins-hbase4:38419] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:03:51,559 INFO [Listener at jenkins-hbase4.apache.org/36093] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-01 16:03:51,559 INFO [RS:1;jenkins-hbase4:37191] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-01 16:03:51,562 INFO [RS:0;jenkins-hbase4:38419] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-01 16:03:51,562 INFO [RS:2;jenkins-hbase4:45599] regionserver.HeapMemoryManager(220): Stopping 2023-10-01 16:03:51,562 INFO [RS:0;jenkins-hbase4:38419] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-01 16:03:51,562 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-01 16:03:51,562 INFO [RS:0;jenkins-hbase4:38419] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-01 16:03:51,562 INFO [RS:2;jenkins-hbase4:45599] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-01 16:03:51,562 INFO [RS:1;jenkins-hbase4:37191] regionserver.HRegionServer(3305): Received CLOSE for 0f8721e5a3a091a4ec523f0203fe22fb 2023-10-01 16:03:51,562 INFO [RS:2;jenkins-hbase4:45599] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-01 16:03:51,562 INFO [RS:0;jenkins-hbase4:38419] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-01 16:03:51,562 INFO [RS:2;jenkins-hbase4:45599] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:51,563 DEBUG [RS:2;jenkins-hbase4:45599] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45cf7bd4 to 127.0.0.1:60886 2023-10-01 16:03:51,563 DEBUG [RS:2;jenkins-hbase4:45599] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:03:51,563 INFO [RS:2;jenkins-hbase4:45599] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45599,1696176089006; all regions closed. 2023-10-01 16:03:51,563 INFO [RS:1;jenkins-hbase4:37191] regionserver.HRegionServer(3305): Received CLOSE for 69908950ff7a37f7d0523ae70d9fab14 2023-10-01 16:03:51,563 INFO [RS:0;jenkins-hbase4:38419] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-01 16:03:51,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0f8721e5a3a091a4ec523f0203fe22fb, disabling compactions & flushes 2023-10-01 16:03:51,563 INFO [RS:1;jenkins-hbase4:37191] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:03:51,564 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696176091101.0f8721e5a3a091a4ec523f0203fe22fb. 2023-10-01 16:03:51,564 DEBUG [RS:1;jenkins-hbase4:37191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66866b15 to 127.0.0.1:60886 2023-10-01 16:03:51,564 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-01 16:03:51,564 DEBUG [RS:1;jenkins-hbase4:37191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:03:51,564 DEBUG [RS:0;jenkins-hbase4:38419] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-10-01 16:03:51,565 INFO [RS:1;jenkins-hbase4:37191] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-10-01 16:03:51,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696176091101.0f8721e5a3a091a4ec523f0203fe22fb. 2023-10-01 16:03:51,565 DEBUG [RS:1;jenkins-hbase4:37191] regionserver.HRegionServer(1478): Online Regions={0f8721e5a3a091a4ec523f0203fe22fb=hbase:namespace,,1696176091101.0f8721e5a3a091a4ec523f0203fe22fb., 69908950ff7a37f7d0523ae70d9fab14=hbase:acl,,1696176091848.69908950ff7a37f7d0523ae70d9fab14.} 2023-10-01 16:03:51,565 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-01 16:03:51,565 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696176091101.0f8721e5a3a091a4ec523f0203fe22fb. after waiting 0 ms 2023-10-01 16:03:51,565 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696176091101.0f8721e5a3a091a4ec523f0203fe22fb. 2023-10-01 16:03:51,565 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-01 16:03:51,565 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 0f8721e5a3a091a4ec523f0203fe22fb 1/1 column families, dataSize=78 B heapSize=488 B 2023-10-01 16:03:51,565 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-01 16:03:51,565 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-01 16:03:51,565 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-10-01 16:03:51,566 DEBUG [RS:0;jenkins-hbase4:38419] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-01 16:03:51,566 DEBUG [RS:1;jenkins-hbase4:37191] regionserver.HRegionServer(1504): Waiting on 0f8721e5a3a091a4ec523f0203fe22fb, 69908950ff7a37f7d0523ae70d9fab14 2023-10-01 16:03:51,586 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-01 16:03:51,586 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-01 16:03:51,586 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-01 16:03:51,604 DEBUG [RS:2;jenkins-hbase4:45599] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/oldWALs 2023-10-01 16:03:51,604 INFO [RS:2;jenkins-hbase4:45599] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45599%2C1696176089006:(num 1696176090666) 2023-10-01 16:03:51,604 DEBUG [RS:2;jenkins-hbase4:45599] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:03:51,604 INFO [RS:2;jenkins-hbase4:45599] regionserver.LeaseManager(133): Closed leases 2023-10-01 16:03:51,609 INFO [RS:2;jenkins-hbase4:45599] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-01 16:03:51,609 INFO [RS:2;jenkins-hbase4:45599] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-01 16:03:51,609 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-01 16:03:51,609 INFO [RS:2;jenkins-hbase4:45599] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-01 16:03:51,609 INFO [RS:2;jenkins-hbase4:45599] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-01 16:03:51,613 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/1588230740/.tmp/info/62e9696641534f0d9643233fce0fa6d4 2023-10-01 16:03:51,617 INFO [RS:2;jenkins-hbase4:45599] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45599 2023-10-01 16:03:51,619 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 62e9696641534f0d9643233fce0fa6d4 2023-10-01 16:03:51,624 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:51,624 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:51,624 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 16:03:51,624 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 16:03:51,624 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 16:03:51,624 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45599,1696176089006 2023-10-01 16:03:51,624 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 16:03:51,625 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45599,1696176089006] 2023-10-01 16:03:51,626 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45599,1696176089006; numProcessing=1 2023-10-01 16:03:51,628 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45599,1696176089006 already deleted, retry=false 2023-10-01 16:03:51,628 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45599,1696176089006 expired; onlineServers=2 2023-10-01 16:03:51,637 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/1588230740/.tmp/rep_barrier/94cc2f18030f487393a6def8d08966e6 2023-10-01 16:03:51,642 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 94cc2f18030f487393a6def8d08966e6 2023-10-01 16:03:51,655 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/1588230740/.tmp/table/163707218faa4e1ebd75ddfca2e05dcb 2023-10-01 16:03:51,659 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 163707218faa4e1ebd75ddfca2e05dcb 2023-10-01 16:03:51,660 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/1588230740/.tmp/info/62e9696641534f0d9643233fce0fa6d4 as hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/1588230740/info/62e9696641534f0d9643233fce0fa6d4 2023-10-01 16:03:51,664 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 62e9696641534f0d9643233fce0fa6d4 2023-10-01 16:03:51,664 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/1588230740/info/62e9696641534f0d9643233fce0fa6d4, entries=48, sequenceid=131, filesize=10.3 K 2023-10-01 16:03:51,664 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/1588230740/.tmp/rep_barrier/94cc2f18030f487393a6def8d08966e6 as hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/1588230740/rep_barrier/94cc2f18030f487393a6def8d08966e6 2023-10-01 16:03:51,668 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 94cc2f18030f487393a6def8d08966e6 2023-10-01 16:03:51,668 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/1588230740/rep_barrier/94cc2f18030f487393a6def8d08966e6, entries=13, sequenceid=131, filesize=6.4 K 2023-10-01 16:03:51,669 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/1588230740/.tmp/table/163707218faa4e1ebd75ddfca2e05dcb as hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/1588230740/table/163707218faa4e1ebd75ddfca2e05dcb 2023-10-01 16:03:51,672 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 163707218faa4e1ebd75ddfca2e05dcb 2023-10-01 16:03:51,672 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/1588230740/table/163707218faa4e1ebd75ddfca2e05dcb, entries=24, sequenceid=131, filesize=6.9 K 2023-10-01 16:03:51,673 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 108ms, sequenceid=131, compaction requested=false 2023-10-01 16:03:51,681 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-10-01 16:03:51,682 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 16:03:51,682 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-01 16:03:51,682 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-01 16:03:51,683 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-01 16:03:51,683 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-01 16:03:51,725 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 16:03:51,725 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:45599-0x10102b856590003, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 16:03:51,725 INFO [RS:2;jenkins-hbase4:45599] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45599,1696176089006; zookeeper connection closed. 2023-10-01 16:03:51,726 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@37c07ae3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@37c07ae3 2023-10-01 16:03:51,766 INFO [RS:0;jenkins-hbase4:38419] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38419,1696176088917; all regions closed. 2023-10-01 16:03:51,766 DEBUG [RS:1;jenkins-hbase4:37191] regionserver.HRegionServer(1504): Waiting on 0f8721e5a3a091a4ec523f0203fe22fb, 69908950ff7a37f7d0523ae70d9fab14 2023-10-01 16:03:51,771 DEBUG [RS:0;jenkins-hbase4:38419] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/oldWALs 2023-10-01 16:03:51,771 INFO [RS:0;jenkins-hbase4:38419] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38419%2C1696176088917.meta:.meta(num 1696176090798) 2023-10-01 16:03:51,777 DEBUG [RS:0;jenkins-hbase4:38419] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/oldWALs 2023-10-01 16:03:51,777 INFO [RS:0;jenkins-hbase4:38419] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38419%2C1696176088917:(num 1696176090666) 2023-10-01 16:03:51,777 DEBUG [RS:0;jenkins-hbase4:38419] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:03:51,777 INFO [RS:0;jenkins-hbase4:38419] regionserver.LeaseManager(133): Closed leases 2023-10-01 16:03:51,777 INFO [RS:0;jenkins-hbase4:38419] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-01 16:03:51,778 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-01 16:03:51,779 INFO [RS:0;jenkins-hbase4:38419] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38419 2023-10-01 16:03:51,780 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:51,780 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38419,1696176088917 2023-10-01 16:03:51,780 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 16:03:51,781 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38419,1696176088917] 2023-10-01 16:03:51,781 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38419,1696176088917; numProcessing=2 2023-10-01 16:03:51,782 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38419,1696176088917 already deleted, retry=false 2023-10-01 16:03:51,782 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38419,1696176088917 expired; onlineServers=1 2023-10-01 16:03:51,881 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 16:03:51,881 INFO [RS:0;jenkins-hbase4:38419] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38419,1696176088917; zookeeper connection closed. 2023-10-01 16:03:51,881 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:38419-0x10102b856590001, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 16:03:51,882 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4afcf145] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4afcf145 2023-10-01 16:03:51,967 DEBUG [RS:1;jenkins-hbase4:37191] regionserver.HRegionServer(1504): Waiting on 0f8721e5a3a091a4ec523f0203fe22fb, 69908950ff7a37f7d0523ae70d9fab14 2023-10-01 16:03:52,020 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/namespace/0f8721e5a3a091a4ec523f0203fe22fb/.tmp/info/ce4d06b2847a4399b66dca40d25b6534 2023-10-01 16:03:52,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/namespace/0f8721e5a3a091a4ec523f0203fe22fb/.tmp/info/ce4d06b2847a4399b66dca40d25b6534 as hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/namespace/0f8721e5a3a091a4ec523f0203fe22fb/info/ce4d06b2847a4399b66dca40d25b6534 2023-10-01 16:03:52,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/namespace/0f8721e5a3a091a4ec523f0203fe22fb/info/ce4d06b2847a4399b66dca40d25b6534, entries=2, sequenceid=6, filesize=4.8 K 2023-10-01 16:03:52,030 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 0f8721e5a3a091a4ec523f0203fe22fb in 465ms, sequenceid=6, compaction requested=false 2023-10-01 16:03:52,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/namespace/0f8721e5a3a091a4ec523f0203fe22fb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 16:03:52,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 16:03:52,038 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696176091101.0f8721e5a3a091a4ec523f0203fe22fb. 2023-10-01 16:03:52,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0f8721e5a3a091a4ec523f0203fe22fb: 2023-10-01 16:03:52,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1696176091101.0f8721e5a3a091a4ec523f0203fe22fb. 2023-10-01 16:03:52,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 69908950ff7a37f7d0523ae70d9fab14, disabling compactions & flushes 2023-10-01 16:03:52,038 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696176091848.69908950ff7a37f7d0523ae70d9fab14. 2023-10-01 16:03:52,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696176091848.69908950ff7a37f7d0523ae70d9fab14. 2023-10-01 16:03:52,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696176091848.69908950ff7a37f7d0523ae70d9fab14. after waiting 0 ms 2023-10-01 16:03:52,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696176091848.69908950ff7a37f7d0523ae70d9fab14. 2023-10-01 16:03:52,039 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 69908950ff7a37f7d0523ae70d9fab14 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-10-01 16:03:52,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/acl/69908950ff7a37f7d0523ae70d9fab14/.tmp/l/91e090e0fa2049138b4de68c708b517d 2023-10-01 16:03:52,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 91e090e0fa2049138b4de68c708b517d 2023-10-01 16:03:52,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/acl/69908950ff7a37f7d0523ae70d9fab14/.tmp/l/91e090e0fa2049138b4de68c708b517d as hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/acl/69908950ff7a37f7d0523ae70d9fab14/l/91e090e0fa2049138b4de68c708b517d 2023-10-01 16:03:52,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 91e090e0fa2049138b4de68c708b517d 2023-10-01 16:03:52,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/acl/69908950ff7a37f7d0523ae70d9fab14/l/91e090e0fa2049138b4de68c708b517d, entries=7, sequenceid=18, filesize=5.2 K 2023-10-01 16:03:52,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 69908950ff7a37f7d0523ae70d9fab14 in 26ms, sequenceid=18, compaction requested=false 2023-10-01 16:03:52,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/data/hbase/acl/69908950ff7a37f7d0523ae70d9fab14/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-10-01 16:03:52,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 16:03:52,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1696176091848.69908950ff7a37f7d0523ae70d9fab14. 2023-10-01 16:03:52,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 69908950ff7a37f7d0523ae70d9fab14: 2023-10-01 16:03:52,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1696176091848.69908950ff7a37f7d0523ae70d9fab14. 2023-10-01 16:03:52,167 INFO [RS:1;jenkins-hbase4:37191] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37191,1696176088973; all regions closed. 2023-10-01 16:03:52,172 DEBUG [RS:1;jenkins-hbase4:37191] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/oldWALs 2023-10-01 16:03:52,172 INFO [RS:1;jenkins-hbase4:37191] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37191%2C1696176088973:(num 1696176090666) 2023-10-01 16:03:52,172 DEBUG [RS:1;jenkins-hbase4:37191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:03:52,172 INFO [RS:1;jenkins-hbase4:37191] regionserver.LeaseManager(133): Closed leases 2023-10-01 16:03:52,172 INFO [RS:1;jenkins-hbase4:37191] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-01 16:03:52,172 INFO [RS:1;jenkins-hbase4:37191] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-01 16:03:52,172 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-01 16:03:52,172 INFO [RS:1;jenkins-hbase4:37191] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-01 16:03:52,172 INFO [RS:1;jenkins-hbase4:37191] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-01 16:03:52,173 INFO [RS:1;jenkins-hbase4:37191] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37191 2023-10-01 16:03:52,177 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 16:03:52,177 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37191,1696176088973 2023-10-01 16:03:52,178 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37191,1696176088973] 2023-10-01 16:03:52,178 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37191,1696176088973; numProcessing=3 2023-10-01 16:03:52,179 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37191,1696176088973 already deleted, retry=false 2023-10-01 16:03:52,179 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37191,1696176088973 expired; onlineServers=0 2023-10-01 16:03:52,179 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42819,1696176087651' ***** 2023-10-01 16:03:52,179 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-01 16:03:52,180 DEBUG [M:0;jenkins-hbase4:42819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3820eed2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-01 16:03:52,180 INFO [M:0;jenkins-hbase4:42819] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42819,1696176087651 2023-10-01 16:03:52,180 INFO [M:0;jenkins-hbase4:42819] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42819,1696176087651; all regions closed. 2023-10-01 16:03:52,180 DEBUG [M:0;jenkins-hbase4:42819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 16:03:52,180 DEBUG [M:0;jenkins-hbase4:42819] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-01 16:03:52,180 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-01 16:03:52,180 DEBUG [M:0;jenkins-hbase4:42819] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-01 16:03:52,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696176090287] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696176090287,5,FailOnTimeoutGroup] 2023-10-01 16:03:52,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696176090287] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696176090287,5,FailOnTimeoutGroup] 2023-10-01 16:03:52,180 INFO [M:0;jenkins-hbase4:42819] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-01 16:03:52,180 INFO [M:0;jenkins-hbase4:42819] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-01 16:03:52,180 INFO [M:0;jenkins-hbase4:42819] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-10-01 16:03:52,180 DEBUG [M:0;jenkins-hbase4:42819] master.HMaster(1512): Stopping service threads 2023-10-01 16:03:52,180 INFO [M:0;jenkins-hbase4:42819] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-01 16:03:52,181 ERROR [M:0;jenkins-hbase4:42819] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-13,5,PEWorkerGroup] 2023-10-01 16:03:52,181 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-10-01 16:03:52,181 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 16:03:52,181 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-01 16:03:52,181 INFO [M:0;jenkins-hbase4:42819] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-01 16:03:52,181 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-01 16:03:52,182 DEBUG [M:0;jenkins-hbase4:42819] zookeeper.ZKUtil(398): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-01 16:03:52,182 WARN [M:0;jenkins-hbase4:42819] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-01 16:03:52,182 INFO [M:0;jenkins-hbase4:42819] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-01 16:03:52,182 INFO [M:0;jenkins-hbase4:42819] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-01 16:03:52,183 DEBUG [M:0;jenkins-hbase4:42819] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-01 16:03:52,183 INFO [M:0;jenkins-hbase4:42819] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 16:03:52,183 DEBUG [M:0;jenkins-hbase4:42819] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 16:03:52,183 DEBUG [M:0;jenkins-hbase4:42819] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-01 16:03:52,183 DEBUG [M:0;jenkins-hbase4:42819] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 16:03:52,183 INFO [M:0;jenkins-hbase4:42819] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.89 KB heapSize=452.13 KB 2023-10-01 16:03:52,197 INFO [M:0;jenkins-hbase4:42819] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.89 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/417be92c7bd44ca0addd60301594edb8 2023-10-01 16:03:52,201 INFO [M:0;jenkins-hbase4:42819] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 417be92c7bd44ca0addd60301594edb8 2023-10-01 16:03:52,202 DEBUG [M:0;jenkins-hbase4:42819] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/417be92c7bd44ca0addd60301594edb8 as hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/417be92c7bd44ca0addd60301594edb8 2023-10-01 16:03:52,206 INFO [M:0;jenkins-hbase4:42819] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 417be92c7bd44ca0addd60301594edb8 2023-10-01 16:03:52,206 INFO [M:0;jenkins-hbase4:42819] regionserver.HStore(1080): Added hdfs://localhost:44103/user/jenkins/test-data/b254c91d-ef1d-ca6b-6153-65b7510b94dc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/417be92c7bd44ca0addd60301594edb8, entries=119, sequenceid=899, filesize=28.7 K 2023-10-01 16:03:52,207 INFO [M:0;jenkins-hbase4:42819] regionserver.HRegion(2948): Finished flush of dataSize ~375.89 KB/384915, heapSize ~452.11 KB/462960, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=899, compaction requested=false 2023-10-01 16:03:52,208 INFO [M:0;jenkins-hbase4:42819] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 16:03:52,208 DEBUG [M:0;jenkins-hbase4:42819] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-01 16:03:52,212 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-01 16:03:52,212 INFO [M:0;jenkins-hbase4:42819] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-01 16:03:52,213 INFO [M:0;jenkins-hbase4:42819] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42819 2023-10-01 16:03:52,215 DEBUG [M:0;jenkins-hbase4:42819] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42819,1696176087651 already deleted, retry=false 2023-10-01 16:03:52,278 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 16:03:52,278 INFO [RS:1;jenkins-hbase4:37191] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37191,1696176088973; zookeeper connection closed. 2023-10-01 16:03:52,278 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): regionserver:37191-0x10102b856590002, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 16:03:52,279 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@75326f89] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@75326f89 2023-10-01 16:03:52,279 INFO [Listener at jenkins-hbase4.apache.org/36093] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-10-01 16:03:52,379 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 16:03:52,379 INFO [M:0;jenkins-hbase4:42819] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42819,1696176087651; zookeeper connection closed. 2023-10-01 16:03:52,379 DEBUG [Listener at localhost/35661-EventThread] zookeeper.ZKWatcher(600): master:42819-0x10102b856590000, quorum=127.0.0.1:60886, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 16:03:52,381 WARN [Listener at jenkins-hbase4.apache.org/36093] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-01 16:03:52,383 INFO [Listener at jenkins-hbase4.apache.org/36093] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-01 16:03:52,486 WARN [BP-1263719286-172.31.14.131-1696176083966 heartbeating to localhost/127.0.0.1:44103] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-01 16:03:52,486 WARN [BP-1263719286-172.31.14.131-1696176083966 heartbeating to localhost/127.0.0.1:44103] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1263719286-172.31.14.131-1696176083966 (Datanode Uuid af549173-8281-4f72-b7a1-cc0fa29d1848) service to localhost/127.0.0.1:44103 2023-10-01 16:03:52,488 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/cluster_dc626531-59bc-a717-57a6-1c05e4c967d9/dfs/data/data5/current/BP-1263719286-172.31.14.131-1696176083966] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 16:03:52,488 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/cluster_dc626531-59bc-a717-57a6-1c05e4c967d9/dfs/data/data6/current/BP-1263719286-172.31.14.131-1696176083966] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 16:03:52,489 WARN [Listener at jenkins-hbase4.apache.org/36093] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-01 16:03:52,491 INFO [Listener at jenkins-hbase4.apache.org/36093] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-01 16:03:52,594 WARN [BP-1263719286-172.31.14.131-1696176083966 heartbeating to localhost/127.0.0.1:44103] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-01 16:03:52,594 WARN [BP-1263719286-172.31.14.131-1696176083966 heartbeating to localhost/127.0.0.1:44103] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1263719286-172.31.14.131-1696176083966 (Datanode Uuid 9af86bd0-04d3-4a33-9fe0-4f1029e12f89) service to localhost/127.0.0.1:44103 2023-10-01 16:03:52,594 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/cluster_dc626531-59bc-a717-57a6-1c05e4c967d9/dfs/data/data3/current/BP-1263719286-172.31.14.131-1696176083966] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 16:03:52,595 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/cluster_dc626531-59bc-a717-57a6-1c05e4c967d9/dfs/data/data4/current/BP-1263719286-172.31.14.131-1696176083966] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 16:03:52,595 WARN [Listener at jenkins-hbase4.apache.org/36093] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-01 16:03:52,597 INFO [Listener at jenkins-hbase4.apache.org/36093] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-01 16:03:52,700 WARN [BP-1263719286-172.31.14.131-1696176083966 heartbeating to localhost/127.0.0.1:44103] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-01 16:03:52,700 WARN [BP-1263719286-172.31.14.131-1696176083966 heartbeating to localhost/127.0.0.1:44103] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1263719286-172.31.14.131-1696176083966 (Datanode Uuid 639bbc82-c3c4-4c86-8526-31d653a0782b) service to localhost/127.0.0.1:44103 2023-10-01 16:03:52,701 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/cluster_dc626531-59bc-a717-57a6-1c05e4c967d9/dfs/data/data1/current/BP-1263719286-172.31.14.131-1696176083966] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 16:03:52,701 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2cd1fecc-f2e0-c193-68e9-8b66d0bf5d9d/cluster_dc626531-59bc-a717-57a6-1c05e4c967d9/dfs/data/data2/current/BP-1263719286-172.31.14.131-1696176083966] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 16:03:52,721 INFO [Listener at jenkins-hbase4.apache.org/36093] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-01 16:03:52,848 INFO [Listener at jenkins-hbase4.apache.org/36093] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-01 16:03:52,939 INFO [Listener at jenkins-hbase4.apache.org/36093] hbase.HBaseTestingUtility(1293): Minicluster is down