2023-10-05 08:59:55,131 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-10-05 08:59:55,335 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532 2023-10-05 08:59:55,335 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-10-05 08:59:55,335 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-10-05 08:59:55,370 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-05 08:59:55,592 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-05 08:59:55,593 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/cluster_b0202d10-b338-417a-fd42-e9b01be8eb27, deleteOnExit=true 2023-10-05 08:59:55,593 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-05 08:59:55,593 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/test.cache.data in system properties and HBase conf 2023-10-05 08:59:55,594 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/hadoop.tmp.dir in system properties and HBase conf 2023-10-05 08:59:55,594 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/hadoop.log.dir in system properties and HBase conf 2023-10-05 08:59:55,594 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-05 08:59:55,595 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-05 08:59:55,595 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-05 08:59:55,861 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-05 08:59:55,865 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-05 08:59:55,866 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-05 08:59:55,866 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-05 08:59:55,866 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-05 08:59:55,867 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-05 08:59:55,867 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-05 08:59:55,868 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-05 08:59:55,868 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-05 08:59:55,869 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-05 08:59:55,869 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/nfs.dump.dir in system properties and HBase conf 2023-10-05 08:59:55,870 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/java.io.tmpdir in system properties and HBase conf 2023-10-05 08:59:55,870 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-05 08:59:55,870 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-05 08:59:55,871 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-05 08:59:56,333 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-05 08:59:56,337 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-05 08:59:56,605 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-05 08:59:56,765 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-05 08:59:56,780 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 08:59:56,812 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 08:59:56,843 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/java.io.tmpdir/Jetty_localhost_45315_hdfs____qgf9r4/webapp 2023-10-05 08:59:56,978 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45315 2023-10-05 08:59:57,022 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-05 08:59:57,022 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-05 08:59:57,453 WARN [Listener at localhost/45983] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-05 08:59:57,530 WARN [Listener at localhost/45983] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-05 08:59:57,553 WARN [Listener at localhost/45983] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 08:59:57,559 INFO [Listener at localhost/45983] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 08:59:57,565 INFO [Listener at localhost/45983] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/java.io.tmpdir/Jetty_localhost_45309_datanode____21qrb6/webapp 2023-10-05 08:59:57,662 INFO [Listener at localhost/45983] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45309 2023-10-05 08:59:58,087 WARN [Listener at localhost/40207] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-05 08:59:58,103 WARN [Listener at localhost/40207] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-05 08:59:58,108 WARN [Listener at localhost/40207] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 08:59:58,110 INFO [Listener at localhost/40207] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 08:59:58,117 INFO [Listener at localhost/40207] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/java.io.tmpdir/Jetty_localhost_35457_datanode____.ri1dyd/webapp 2023-10-05 08:59:58,224 INFO [Listener at localhost/40207] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35457 2023-10-05 08:59:58,237 WARN [Listener at localhost/43903] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-05 08:59:58,254 WARN [Listener at localhost/43903] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-05 08:59:58,260 WARN [Listener at localhost/43903] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 08:59:58,262 INFO [Listener at localhost/43903] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 08:59:58,270 INFO [Listener at localhost/43903] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/java.io.tmpdir/Jetty_localhost_42405_datanode____oswo2/webapp 2023-10-05 08:59:58,402 INFO [Listener at localhost/43903] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42405 2023-10-05 08:59:58,418 WARN [Listener at localhost/46441] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-05 08:59:58,569 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7c1161c100da4f63: Processing first storage report for DS-982b4e12-2a00-4b1c-95d3-a7165dc3634a from datanode 06c9bf79-ab11-4ff6-a4a2-fd5d3f60aa47 2023-10-05 08:59:58,570 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7c1161c100da4f63: from storage DS-982b4e12-2a00-4b1c-95d3-a7165dc3634a node DatanodeRegistration(127.0.0.1:35179, datanodeUuid=06c9bf79-ab11-4ff6-a4a2-fd5d3f60aa47, infoPort=41251, infoSecurePort=0, ipcPort=46441, storageInfo=lv=-57;cid=testClusterID;nsid=1000179422;c=1696496396405), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-10-05 08:59:58,570 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9c398f91a7b97b11: Processing first storage report for DS-f60e74d0-7c69-4769-8384-725db370650c from datanode 8ce18163-78c5-466b-b973-eb55768da98f 2023-10-05 08:59:58,571 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9c398f91a7b97b11: from storage DS-f60e74d0-7c69-4769-8384-725db370650c node DatanodeRegistration(127.0.0.1:43503, datanodeUuid=8ce18163-78c5-466b-b973-eb55768da98f, infoPort=41135, infoSecurePort=0, ipcPort=40207, storageInfo=lv=-57;cid=testClusterID;nsid=1000179422;c=1696496396405), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-05 08:59:58,571 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2da65dde5accdcaa: Processing first storage report for DS-79a5c6e0-9772-45b7-b13c-d3288d91fe54 from datanode 2d57baff-58d4-4ef6-8cca-ba5afb4aabd2 2023-10-05 08:59:58,571 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2da65dde5accdcaa: from storage DS-79a5c6e0-9772-45b7-b13c-d3288d91fe54 node DatanodeRegistration(127.0.0.1:45003, datanodeUuid=2d57baff-58d4-4ef6-8cca-ba5afb4aabd2, infoPort=32785, infoSecurePort=0, ipcPort=43903, storageInfo=lv=-57;cid=testClusterID;nsid=1000179422;c=1696496396405), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-05 08:59:58,571 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7c1161c100da4f63: Processing first storage report for DS-1b047198-16de-4191-9372-3bd94da6f426 from datanode 06c9bf79-ab11-4ff6-a4a2-fd5d3f60aa47 2023-10-05 08:59:58,571 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7c1161c100da4f63: from storage DS-1b047198-16de-4191-9372-3bd94da6f426 node DatanodeRegistration(127.0.0.1:35179, datanodeUuid=06c9bf79-ab11-4ff6-a4a2-fd5d3f60aa47, infoPort=41251, infoSecurePort=0, ipcPort=46441, storageInfo=lv=-57;cid=testClusterID;nsid=1000179422;c=1696496396405), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-05 08:59:58,571 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9c398f91a7b97b11: Processing first storage report for DS-bc203a28-f816-46e4-934c-530f7a3d605d from datanode 8ce18163-78c5-466b-b973-eb55768da98f 2023-10-05 08:59:58,571 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9c398f91a7b97b11: from storage DS-bc203a28-f816-46e4-934c-530f7a3d605d node DatanodeRegistration(127.0.0.1:43503, datanodeUuid=8ce18163-78c5-466b-b973-eb55768da98f, infoPort=41135, infoSecurePort=0, ipcPort=40207, storageInfo=lv=-57;cid=testClusterID;nsid=1000179422;c=1696496396405), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-05 08:59:58,571 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2da65dde5accdcaa: Processing first storage report for DS-3e919beb-866a-4134-a70d-9839455aec86 from datanode 2d57baff-58d4-4ef6-8cca-ba5afb4aabd2 2023-10-05 08:59:58,572 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2da65dde5accdcaa: from storage DS-3e919beb-866a-4134-a70d-9839455aec86 node DatanodeRegistration(127.0.0.1:45003, datanodeUuid=2d57baff-58d4-4ef6-8cca-ba5afb4aabd2, infoPort=32785, infoSecurePort=0, ipcPort=43903, storageInfo=lv=-57;cid=testClusterID;nsid=1000179422;c=1696496396405), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-05 08:59:58,826 DEBUG [Listener at localhost/46441] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532 2023-10-05 08:59:58,902 INFO [Listener at localhost/46441] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/cluster_b0202d10-b338-417a-fd42-e9b01be8eb27/zookeeper_0, clientPort=63699, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/cluster_b0202d10-b338-417a-fd42-e9b01be8eb27/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/cluster_b0202d10-b338-417a-fd42-e9b01be8eb27/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-05 08:59:58,924 INFO [Listener at localhost/46441] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63699 2023-10-05 08:59:58,936 INFO [Listener at localhost/46441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 08:59:58,939 INFO [Listener at localhost/46441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 08:59:59,602 INFO [Listener at localhost/46441] util.FSUtils(471): Created version file at hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c with version=8 2023-10-05 08:59:59,603 INFO [Listener at localhost/46441] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/hbase-staging 2023-10-05 08:59:59,950 INFO [Listener at localhost/46441] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-05 09:00:00,502 INFO [Listener at localhost/46441] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-10-05 09:00:00,539 INFO [Listener at localhost/46441] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 09:00:00,539 INFO [Listener at localhost/46441] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-05 09:00:00,539 INFO [Listener at localhost/46441] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-05 09:00:00,539 INFO [Listener at localhost/46441] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 09:00:00,540 INFO [Listener at localhost/46441] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-05 09:00:00,689 INFO [Listener at localhost/46441] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-05 09:00:00,761 DEBUG [Listener at localhost/46441] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-05 09:00:00,855 INFO [Listener at localhost/46441] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37915 2023-10-05 09:00:00,868 INFO [Listener at localhost/46441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 09:00:00,870 INFO [Listener at localhost/46441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 09:00:00,893 INFO [Listener at localhost/46441] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37915 connecting to ZooKeeper ensemble=127.0.0.1:63699 2023-10-05 09:00:00,941 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:379150x0, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-05 09:00:00,944 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:37915-0x10115cfe9c60000 connected 2023-10-05 09:00:00,976 DEBUG [Listener at localhost/46441] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 09:00:00,977 DEBUG [Listener at localhost/46441] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 09:00:00,990 DEBUG [Listener at localhost/46441] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-05 09:00:00,998 DEBUG [Listener at localhost/46441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37915 2023-10-05 09:00:00,999 DEBUG [Listener at localhost/46441] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37915 2023-10-05 09:00:00,999 DEBUG [Listener at localhost/46441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37915 2023-10-05 09:00:01,000 DEBUG [Listener at localhost/46441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37915 2023-10-05 09:00:01,000 DEBUG [Listener at localhost/46441] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37915 2023-10-05 09:00:01,007 INFO [Listener at localhost/46441] master.HMaster(444): hbase.rootdir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c, hbase.cluster.distributed=false 2023-10-05 09:00:01,071 INFO [Listener at localhost/46441] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-05 09:00:01,071 INFO [Listener at localhost/46441] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 09:00:01,071 INFO [Listener at localhost/46441] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-05 09:00:01,071 INFO [Listener at localhost/46441] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-05 09:00:01,072 INFO [Listener at localhost/46441] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 09:00:01,072 INFO [Listener at localhost/46441] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-05 09:00:01,076 INFO [Listener at localhost/46441] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-05 09:00:01,079 INFO [Listener at localhost/46441] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41057 2023-10-05 09:00:01,082 INFO [Listener at localhost/46441] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-05 09:00:01,089 INFO [Listener at localhost/46441] mob.MobFileCache(125): MobFileCache disabled 2023-10-05 09:00:01,090 INFO [Listener at localhost/46441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 09:00:01,092 INFO [Listener at localhost/46441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 09:00:01,095 INFO [Listener at localhost/46441] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41057 connecting to ZooKeeper ensemble=127.0.0.1:63699 2023-10-05 09:00:01,100 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:410570x0, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-05 09:00:01,101 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41057-0x10115cfe9c60001 connected 2023-10-05 09:00:01,102 DEBUG [Listener at localhost/46441] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 09:00:01,103 DEBUG [Listener at localhost/46441] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 09:00:01,104 DEBUG [Listener at localhost/46441] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-05 09:00:01,104 DEBUG [Listener at localhost/46441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41057 2023-10-05 09:00:01,104 DEBUG [Listener at localhost/46441] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41057 2023-10-05 09:00:01,105 DEBUG [Listener at localhost/46441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41057 2023-10-05 09:00:01,106 DEBUG [Listener at localhost/46441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41057 2023-10-05 09:00:01,107 DEBUG [Listener at localhost/46441] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41057 2023-10-05 09:00:01,119 INFO [Listener at localhost/46441] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-05 09:00:01,119 INFO [Listener at localhost/46441] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 09:00:01,120 INFO [Listener at localhost/46441] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-05 09:00:01,120 INFO [Listener at localhost/46441] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-05 09:00:01,120 INFO [Listener at localhost/46441] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 09:00:01,120 INFO [Listener at localhost/46441] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-05 09:00:01,120 INFO [Listener at localhost/46441] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-05 09:00:01,123 INFO [Listener at localhost/46441] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40073 2023-10-05 09:00:01,123 INFO [Listener at localhost/46441] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-05 09:00:01,124 INFO [Listener at localhost/46441] mob.MobFileCache(125): MobFileCache disabled 2023-10-05 09:00:01,125 INFO [Listener at localhost/46441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 09:00:01,127 INFO [Listener at localhost/46441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 09:00:01,130 INFO [Listener at localhost/46441] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40073 connecting to ZooKeeper ensemble=127.0.0.1:63699 2023-10-05 09:00:01,135 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:400730x0, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-05 09:00:01,136 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40073-0x10115cfe9c60002 connected 2023-10-05 09:00:01,136 DEBUG [Listener at localhost/46441] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 09:00:01,137 DEBUG [Listener at localhost/46441] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 09:00:01,137 DEBUG [Listener at localhost/46441] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-05 09:00:01,141 DEBUG [Listener at localhost/46441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40073 2023-10-05 09:00:01,141 DEBUG [Listener at localhost/46441] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40073 2023-10-05 09:00:01,141 DEBUG [Listener at localhost/46441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40073 2023-10-05 09:00:01,142 DEBUG [Listener at localhost/46441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40073 2023-10-05 09:00:01,142 DEBUG [Listener at localhost/46441] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40073 2023-10-05 09:00:01,155 INFO [Listener at localhost/46441] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-05 09:00:01,155 INFO [Listener at localhost/46441] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 09:00:01,155 INFO [Listener at localhost/46441] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-05 09:00:01,155 INFO [Listener at localhost/46441] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-05 09:00:01,156 INFO [Listener at localhost/46441] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 09:00:01,156 INFO [Listener at localhost/46441] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-05 09:00:01,156 INFO [Listener at localhost/46441] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-05 09:00:01,157 INFO [Listener at localhost/46441] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35953 2023-10-05 09:00:01,158 INFO [Listener at localhost/46441] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-05 09:00:01,161 INFO [Listener at localhost/46441] mob.MobFileCache(125): MobFileCache disabled 2023-10-05 09:00:01,162 INFO [Listener at localhost/46441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 09:00:01,164 INFO [Listener at localhost/46441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 09:00:01,165 INFO [Listener at localhost/46441] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35953 connecting to ZooKeeper ensemble=127.0.0.1:63699 2023-10-05 09:00:01,169 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:359530x0, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-05 09:00:01,170 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35953-0x10115cfe9c60003 connected 2023-10-05 09:00:01,171 DEBUG [Listener at localhost/46441] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 09:00:01,171 DEBUG [Listener at localhost/46441] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 09:00:01,172 DEBUG [Listener at localhost/46441] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-05 09:00:01,173 DEBUG [Listener at localhost/46441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35953 2023-10-05 09:00:01,173 DEBUG [Listener at localhost/46441] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35953 2023-10-05 09:00:01,173 DEBUG [Listener at localhost/46441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35953 2023-10-05 09:00:01,181 DEBUG [Listener at localhost/46441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35953 2023-10-05 09:00:01,181 DEBUG [Listener at localhost/46441] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35953 2023-10-05 09:00:01,183 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37915,1696496399783 2023-10-05 09:00:01,193 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-05 09:00:01,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37915,1696496399783 2023-10-05 09:00:01,214 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-05 09:00:01,214 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-05 09:00:01,214 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-05 09:00:01,214 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-05 09:00:01,215 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 09:00:01,216 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-05 09:00:01,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37915,1696496399783 from backup master directory 2023-10-05 09:00:01,218 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-05 09:00:01,222 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37915,1696496399783 2023-10-05 09:00:01,222 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-05 09:00:01,223 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-05 09:00:01,223 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,37915,1696496399783 2023-10-05 09:00:01,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-05 09:00:01,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-05 09:00:01,320 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/hbase.id with ID: 9557ed2f-89e8-438d-88ec-40ae83782ad2 2023-10-05 09:00:01,364 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 09:00:01,379 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 09:00:01,431 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x17d8be45 to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:00:01,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f7b7821, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:00:01,497 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-05 09:00:01,499 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-05 09:00:01,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-05 09:00:01,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-05 09:00:01,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-05 09:00:01,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-05 09:00:01,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 09:00:01,567 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/MasterData/data/master/store-tmp 2023-10-05 09:00:01,606 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:00:01,606 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-05 09:00:01,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 09:00:01,606 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 09:00:01,606 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-05 09:00:01,606 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 09:00:01,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 09:00:01,606 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-05 09:00:01,609 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/MasterData/WALs/jenkins-hbase4.apache.org,37915,1696496399783 2023-10-05 09:00:01,631 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37915%2C1696496399783, suffix=, logDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/MasterData/WALs/jenkins-hbase4.apache.org,37915,1696496399783, archiveDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/MasterData/oldWALs, maxLogs=10 2023-10-05 09:00:01,691 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45003,DS-79a5c6e0-9772-45b7-b13c-d3288d91fe54,DISK] 2023-10-05 09:00:01,691 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35179,DS-982b4e12-2a00-4b1c-95d3-a7165dc3634a,DISK] 2023-10-05 09:00:01,691 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43503,DS-f60e74d0-7c69-4769-8384-725db370650c,DISK] 2023-10-05 09:00:01,700 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-05 09:00:01,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/MasterData/WALs/jenkins-hbase4.apache.org,37915,1696496399783/jenkins-hbase4.apache.org%2C37915%2C1696496399783.1696496401642 2023-10-05 09:00:01,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35179,DS-982b4e12-2a00-4b1c-95d3-a7165dc3634a,DISK], DatanodeInfoWithStorage[127.0.0.1:43503,DS-f60e74d0-7c69-4769-8384-725db370650c,DISK], DatanodeInfoWithStorage[127.0.0.1:45003,DS-79a5c6e0-9772-45b7-b13c-d3288d91fe54,DISK]] 2023-10-05 09:00:01,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-05 09:00:01,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:00:01,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-05 09:00:01,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-05 09:00:01,875 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-05 09:00:01,884 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-05 09:00:01,926 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-05 09:00:01,944 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 09:00:01,950 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-05 09:00:01,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-05 09:00:01,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-05 09:00:01,972 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 09:00:01,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73079518, jitterRate=0.08896967768669128}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 09:00:01,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-05 09:00:01,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-05 09:00:01,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-05 09:00:01,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-05 09:00:02,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-05 09:00:02,002 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-05 09:00:02,040 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 37 msec 2023-10-05 09:00:02,040 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-05 09:00:02,072 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-05 09:00:02,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-05 09:00:02,110 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-05 09:00:02,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-05 09:00:02,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-05 09:00:02,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-05 09:00:02,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-05 09:00:02,135 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 09:00:02,137 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-05 09:00:02,137 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-05 09:00:02,154 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-05 09:00:02,158 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-05 09:00:02,158 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-05 09:00:02,159 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-05 09:00:02,159 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-05 09:00:02,159 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 09:00:02,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,37915,1696496399783, sessionid=0x10115cfe9c60000, setting cluster-up flag (Was=false) 2023-10-05 09:00:02,178 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 09:00:02,184 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-05 09:00:02,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37915,1696496399783 2023-10-05 09:00:02,193 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 09:00:02,199 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-05 09:00:02,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37915,1696496399783 2023-10-05 09:00:02,204 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp 2023-10-05 09:00:02,286 INFO [RS:1;jenkins-hbase4:40073] regionserver.HRegionServer(951): ClusterId : 9557ed2f-89e8-438d-88ec-40ae83782ad2 2023-10-05 09:00:02,286 INFO [RS:2;jenkins-hbase4:35953] regionserver.HRegionServer(951): ClusterId : 9557ed2f-89e8-438d-88ec-40ae83782ad2 2023-10-05 09:00:02,292 INFO [RS:0;jenkins-hbase4:41057] regionserver.HRegionServer(951): ClusterId : 9557ed2f-89e8-438d-88ec-40ae83782ad2 2023-10-05 09:00:02,294 DEBUG [RS:0;jenkins-hbase4:41057] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-05 09:00:02,295 DEBUG [RS:1;jenkins-hbase4:40073] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-05 09:00:02,295 DEBUG [RS:2;jenkins-hbase4:35953] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-05 09:00:02,305 DEBUG [RS:2;jenkins-hbase4:35953] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-05 09:00:02,305 DEBUG [RS:1;jenkins-hbase4:40073] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-05 09:00:02,305 DEBUG [RS:0;jenkins-hbase4:41057] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-05 09:00:02,305 DEBUG [RS:1;jenkins-hbase4:40073] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-05 09:00:02,305 DEBUG [RS:2;jenkins-hbase4:35953] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-05 09:00:02,305 DEBUG [RS:0;jenkins-hbase4:41057] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-05 09:00:02,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-10-05 09:00:02,310 DEBUG [RS:1;jenkins-hbase4:40073] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-05 09:00:02,310 DEBUG [RS:0;jenkins-hbase4:41057] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-05 09:00:02,313 DEBUG [RS:1;jenkins-hbase4:40073] zookeeper.ReadOnlyZKClient(139): Connect 0x403e3bcc to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:00:02,313 DEBUG [RS:0;jenkins-hbase4:41057] zookeeper.ReadOnlyZKClient(139): Connect 0x42f5b19b to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:00:02,314 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 09:00:02,314 DEBUG [RS:2;jenkins-hbase4:35953] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-05 09:00:02,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-10-05 09:00:02,319 DEBUG [RS:2;jenkins-hbase4:35953] zookeeper.ReadOnlyZKClient(139): Connect 0x48048430 to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:00:02,375 DEBUG [RS:0;jenkins-hbase4:41057] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b76ffca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:00:02,376 DEBUG [RS:1;jenkins-hbase4:40073] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@feaaff5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:00:02,376 DEBUG [RS:0;jenkins-hbase4:41057] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@739dbddd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-05 09:00:02,377 DEBUG [RS:1;jenkins-hbase4:40073] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@759560a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-05 09:00:02,377 DEBUG [RS:2;jenkins-hbase4:35953] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46c36340, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:00:02,377 DEBUG [RS:2;jenkins-hbase4:35953] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fe697b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-05 09:00:02,400 DEBUG [RS:0;jenkins-hbase4:41057] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41057 2023-10-05 09:00:02,401 DEBUG [RS:1;jenkins-hbase4:40073] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40073 2023-10-05 09:00:02,405 DEBUG [RS:2;jenkins-hbase4:35953] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:35953 2023-10-05 09:00:02,405 INFO [RS:0;jenkins-hbase4:41057] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-05 09:00:02,406 INFO [RS:2;jenkins-hbase4:35953] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-05 09:00:02,406 INFO [RS:2;jenkins-hbase4:35953] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-05 09:00:02,405 INFO [RS:1;jenkins-hbase4:40073] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-05 09:00:02,406 INFO [RS:0;jenkins-hbase4:41057] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-05 09:00:02,406 INFO [RS:1;jenkins-hbase4:40073] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-05 09:00:02,406 DEBUG [RS:2;jenkins-hbase4:35953] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-05 09:00:02,406 DEBUG [RS:1;jenkins-hbase4:40073] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-05 09:00:02,406 DEBUG [RS:0;jenkins-hbase4:41057] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-05 09:00:02,407 INFO [RS:1;jenkins-hbase4:40073] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 09:00:02,407 INFO [RS:2;jenkins-hbase4:35953] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 09:00:02,408 INFO [RS:0;jenkins-hbase4:41057] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 09:00:02,408 DEBUG [RS:1;jenkins-hbase4:40073] regionserver.HRegionServer(1022): About to register with Master. 2023-10-05 09:00:02,408 DEBUG [RS:0;jenkins-hbase4:41057] regionserver.HRegionServer(1022): About to register with Master. 2023-10-05 09:00:02,408 DEBUG [RS:2;jenkins-hbase4:35953] regionserver.HRegionServer(1022): About to register with Master. 2023-10-05 09:00:02,411 INFO [RS:1;jenkins-hbase4:40073] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37915,1696496399783 with isa=jenkins-hbase4.apache.org/172.31.14.131:40073, startcode=1696496401119 2023-10-05 09:00:02,411 INFO [RS:0;jenkins-hbase4:41057] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37915,1696496399783 with isa=jenkins-hbase4.apache.org/172.31.14.131:41057, startcode=1696496401070 2023-10-05 09:00:02,411 INFO [RS:2;jenkins-hbase4:35953] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37915,1696496399783 with isa=jenkins-hbase4.apache.org/172.31.14.131:35953, startcode=1696496401154 2023-10-05 09:00:02,422 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-05 09:00:02,431 DEBUG [RS:1;jenkins-hbase4:40073] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-05 09:00:02,431 DEBUG [RS:0;jenkins-hbase4:41057] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-05 09:00:02,431 DEBUG [RS:2;jenkins-hbase4:35953] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-05 09:00:02,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-05 09:00:02,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-05 09:00:02,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-05 09:00:02,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-05 09:00:02,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-10-05 09:00:02,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-05 09:00:02,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1696496432435 2023-10-05 09:00:02,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-05 09:00:02,444 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-05 09:00:02,445 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-05 09:00:02,451 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-05 09:00:02,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-05 09:00:02,472 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-05 09:00:02,472 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-05 09:00:02,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-05 09:00:02,474 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-05 09:00:02,474 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-05 09:00:02,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-05 09:00:02,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-05 09:00:02,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-05 09:00:02,489 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-05 09:00:02,489 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-05 09:00:02,492 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696496402492,5,FailOnTimeoutGroup] 2023-10-05 09:00:02,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696496402492,5,FailOnTimeoutGroup] 2023-10-05 09:00:02,493 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-05 09:00:02,493 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-05 09:00:02,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-05 09:00:02,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-05 09:00:02,507 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48417, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-10-05 09:00:02,507 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52555, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-10-05 09:00:02,507 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44711, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-05 09:00:02,537 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37915] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:02,541 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-05 09:00:02,542 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-05 09:00:02,543 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c 2023-10-05 09:00:02,548 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37915] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:02,550 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37915] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:02,558 DEBUG [RS:2;jenkins-hbase4:35953] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c 2023-10-05 09:00:02,558 DEBUG [RS:1;jenkins-hbase4:40073] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c 2023-10-05 09:00:02,558 DEBUG [RS:0;jenkins-hbase4:41057] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c 2023-10-05 09:00:02,559 DEBUG [RS:1;jenkins-hbase4:40073] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45983 2023-10-05 09:00:02,559 DEBUG [RS:2;jenkins-hbase4:35953] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45983 2023-10-05 09:00:02,559 DEBUG [RS:1;jenkins-hbase4:40073] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-05 09:00:02,559 DEBUG [RS:0;jenkins-hbase4:41057] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45983 2023-10-05 09:00:02,559 DEBUG [RS:2;jenkins-hbase4:35953] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-05 09:00:02,559 DEBUG [RS:0;jenkins-hbase4:41057] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-05 09:00:02,571 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 09:00:02,576 DEBUG [RS:2;jenkins-hbase4:35953] zookeeper.ZKUtil(162): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:02,576 WARN [RS:2;jenkins-hbase4:35953] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-05 09:00:02,576 INFO [RS:2;jenkins-hbase4:35953] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 09:00:02,576 DEBUG [RS:2;jenkins-hbase4:35953] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/WALs/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:02,576 DEBUG [RS:0;jenkins-hbase4:41057] zookeeper.ZKUtil(162): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:02,576 DEBUG [RS:1;jenkins-hbase4:40073] zookeeper.ZKUtil(162): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:02,576 WARN [RS:0;jenkins-hbase4:41057] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-05 09:00:02,576 WARN [RS:1;jenkins-hbase4:40073] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-05 09:00:02,581 INFO [RS:0;jenkins-hbase4:41057] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 09:00:02,581 INFO [RS:1;jenkins-hbase4:40073] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 09:00:02,585 DEBUG [RS:0;jenkins-hbase4:41057] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/WALs/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:02,585 DEBUG [RS:1;jenkins-hbase4:40073] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/WALs/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:02,586 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41057,1696496401070] 2023-10-05 09:00:02,587 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35953,1696496401154] 2023-10-05 09:00:02,587 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40073,1696496401119] 2023-10-05 09:00:02,598 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:00:02,601 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-05 09:00:02,603 DEBUG [RS:0;jenkins-hbase4:41057] zookeeper.ZKUtil(162): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:02,604 DEBUG [RS:1;jenkins-hbase4:40073] zookeeper.ZKUtil(162): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:02,604 DEBUG [RS:2;jenkins-hbase4:35953] zookeeper.ZKUtil(162): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:02,604 DEBUG [RS:1;jenkins-hbase4:40073] zookeeper.ZKUtil(162): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:02,605 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/1588230740/info 2023-10-05 09:00:02,604 DEBUG [RS:0;jenkins-hbase4:41057] zookeeper.ZKUtil(162): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:02,604 DEBUG [RS:2;jenkins-hbase4:35953] zookeeper.ZKUtil(162): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:02,605 DEBUG [RS:1;jenkins-hbase4:40073] zookeeper.ZKUtil(162): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:02,605 DEBUG [RS:0;jenkins-hbase4:41057] zookeeper.ZKUtil(162): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:02,606 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-05 09:00:02,606 DEBUG [RS:2;jenkins-hbase4:35953] zookeeper.ZKUtil(162): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:02,607 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 09:00:02,607 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-05 09:00:02,610 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/1588230740/rep_barrier 2023-10-05 09:00:02,611 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-05 09:00:02,612 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 09:00:02,612 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-05 09:00:02,615 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/1588230740/table 2023-10-05 09:00:02,615 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-05 09:00:02,617 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 09:00:02,619 DEBUG [RS:2;jenkins-hbase4:35953] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-05 09:00:02,619 DEBUG [RS:1;jenkins-hbase4:40073] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-05 09:00:02,619 DEBUG [RS:0;jenkins-hbase4:41057] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-05 09:00:02,626 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/1588230740 2023-10-05 09:00:02,626 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/1588230740 2023-10-05 09:00:02,631 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-05 09:00:02,632 INFO [RS:0;jenkins-hbase4:41057] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-05 09:00:02,632 INFO [RS:1;jenkins-hbase4:40073] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-05 09:00:02,634 INFO [RS:2;jenkins-hbase4:35953] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-05 09:00:02,635 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-05 09:00:02,651 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 09:00:02,653 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62444237, jitterRate=-0.06950835883617401}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-05 09:00:02,653 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-05 09:00:02,653 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-05 09:00:02,653 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-05 09:00:02,653 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-05 09:00:02,653 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-05 09:00:02,653 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-05 09:00:02,658 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-05 09:00:02,658 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-05 09:00:02,665 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-05 09:00:02,665 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-05 09:00:02,674 INFO [RS:2;jenkins-hbase4:35953] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-05 09:00:02,674 INFO [RS:0;jenkins-hbase4:41057] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-05 09:00:02,674 INFO [RS:1;jenkins-hbase4:40073] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-05 09:00:02,679 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-05 09:00:02,681 INFO [RS:1;jenkins-hbase4:40073] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-05 09:00:02,681 INFO [RS:0;jenkins-hbase4:41057] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-05 09:00:02,681 INFO [RS:1;jenkins-hbase4:40073] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 09:00:02,681 INFO [RS:2;jenkins-hbase4:35953] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-05 09:00:02,682 INFO [RS:0;jenkins-hbase4:41057] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 09:00:02,682 INFO [RS:2;jenkins-hbase4:35953] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 09:00:02,685 INFO [RS:1;jenkins-hbase4:40073] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-05 09:00:02,685 INFO [RS:2;jenkins-hbase4:35953] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-05 09:00:02,686 INFO [RS:0;jenkins-hbase4:41057] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-05 09:00:02,695 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-05 09:00:02,696 INFO [RS:2;jenkins-hbase4:35953] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-05 09:00:02,696 DEBUG [RS:2;jenkins-hbase4:35953] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,697 DEBUG [RS:2;jenkins-hbase4:35953] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,697 DEBUG [RS:2;jenkins-hbase4:35953] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,697 DEBUG [RS:2;jenkins-hbase4:35953] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,697 DEBUG [RS:2;jenkins-hbase4:35953] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,697 DEBUG [RS:2;jenkins-hbase4:35953] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-05 09:00:02,697 DEBUG [RS:2;jenkins-hbase4:35953] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,698 DEBUG [RS:2;jenkins-hbase4:35953] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,698 DEBUG [RS:2;jenkins-hbase4:35953] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,698 INFO [RS:1;jenkins-hbase4:40073] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-05 09:00:02,698 INFO [RS:0;jenkins-hbase4:41057] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-05 09:00:02,698 DEBUG [RS:2;jenkins-hbase4:35953] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,699 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-05 09:00:02,699 DEBUG [RS:0;jenkins-hbase4:41057] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,698 DEBUG [RS:1;jenkins-hbase4:40073] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,700 DEBUG [RS:0;jenkins-hbase4:41057] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,700 DEBUG [RS:1;jenkins-hbase4:40073] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,700 DEBUG [RS:0;jenkins-hbase4:41057] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,700 DEBUG [RS:1;jenkins-hbase4:40073] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,700 DEBUG [RS:0;jenkins-hbase4:41057] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,700 DEBUG [RS:1;jenkins-hbase4:40073] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,700 DEBUG [RS:0;jenkins-hbase4:41057] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,700 DEBUG [RS:1;jenkins-hbase4:40073] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,700 DEBUG [RS:0;jenkins-hbase4:41057] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-05 09:00:02,700 DEBUG [RS:1;jenkins-hbase4:40073] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-05 09:00:02,701 DEBUG [RS:0;jenkins-hbase4:41057] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,701 DEBUG [RS:1;jenkins-hbase4:40073] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,701 DEBUG [RS:0;jenkins-hbase4:41057] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,701 DEBUG [RS:1;jenkins-hbase4:40073] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,701 DEBUG [RS:0;jenkins-hbase4:41057] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,701 DEBUG [RS:1;jenkins-hbase4:40073] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,701 DEBUG [RS:0;jenkins-hbase4:41057] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,701 DEBUG [RS:1;jenkins-hbase4:40073] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 09:00:02,703 INFO [RS:1;jenkins-hbase4:40073] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 09:00:02,703 INFO [RS:1;jenkins-hbase4:40073] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 09:00:02,703 INFO [RS:1;jenkins-hbase4:40073] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-05 09:00:02,709 INFO [RS:2;jenkins-hbase4:35953] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 09:00:02,709 INFO [RS:0;jenkins-hbase4:41057] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 09:00:02,709 INFO [RS:2;jenkins-hbase4:35953] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 09:00:02,709 INFO [RS:0;jenkins-hbase4:41057] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 09:00:02,709 INFO [RS:2;jenkins-hbase4:35953] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-05 09:00:02,709 INFO [RS:0;jenkins-hbase4:41057] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-05 09:00:02,720 INFO [RS:1;jenkins-hbase4:40073] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-05 09:00:02,723 INFO [RS:1;jenkins-hbase4:40073] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40073,1696496401119-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 09:00:02,727 INFO [RS:2;jenkins-hbase4:35953] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-05 09:00:02,729 INFO [RS:2;jenkins-hbase4:35953] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35953,1696496401154-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 09:00:02,731 INFO [RS:0;jenkins-hbase4:41057] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-05 09:00:02,731 INFO [RS:0;jenkins-hbase4:41057] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41057,1696496401070-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 09:00:02,754 INFO [RS:2;jenkins-hbase4:35953] regionserver.Replication(203): jenkins-hbase4.apache.org,35953,1696496401154 started 2023-10-05 09:00:02,754 INFO [RS:1;jenkins-hbase4:40073] regionserver.Replication(203): jenkins-hbase4.apache.org,40073,1696496401119 started 2023-10-05 09:00:02,754 INFO [RS:0;jenkins-hbase4:41057] regionserver.Replication(203): jenkins-hbase4.apache.org,41057,1696496401070 started 2023-10-05 09:00:02,754 INFO [RS:1;jenkins-hbase4:40073] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40073,1696496401119, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40073, sessionid=0x10115cfe9c60002 2023-10-05 09:00:02,754 INFO [RS:2;jenkins-hbase4:35953] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35953,1696496401154, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35953, sessionid=0x10115cfe9c60003 2023-10-05 09:00:02,755 INFO [RS:0;jenkins-hbase4:41057] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41057,1696496401070, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41057, sessionid=0x10115cfe9c60001 2023-10-05 09:00:02,755 DEBUG [RS:0;jenkins-hbase4:41057] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-05 09:00:02,755 DEBUG [RS:2;jenkins-hbase4:35953] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-05 09:00:02,755 DEBUG [RS:1;jenkins-hbase4:40073] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-05 09:00:02,755 DEBUG [RS:2;jenkins-hbase4:35953] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:02,755 DEBUG [RS:0;jenkins-hbase4:41057] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:02,756 DEBUG [RS:2;jenkins-hbase4:35953] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35953,1696496401154' 2023-10-05 09:00:02,756 DEBUG [RS:1;jenkins-hbase4:40073] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:02,756 DEBUG [RS:2;jenkins-hbase4:35953] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-05 09:00:02,756 DEBUG [RS:0;jenkins-hbase4:41057] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41057,1696496401070' 2023-10-05 09:00:02,757 DEBUG [RS:0;jenkins-hbase4:41057] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-05 09:00:02,757 DEBUG [RS:2;jenkins-hbase4:35953] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-05 09:00:02,758 DEBUG [RS:2;jenkins-hbase4:35953] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-05 09:00:02,758 DEBUG [RS:2;jenkins-hbase4:35953] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-05 09:00:02,758 DEBUG [RS:2;jenkins-hbase4:35953] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:02,758 DEBUG [RS:2;jenkins-hbase4:35953] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35953,1696496401154' 2023-10-05 09:00:02,758 DEBUG [RS:2;jenkins-hbase4:35953] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:02,758 DEBUG [RS:2;jenkins-hbase4:35953] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:02,756 DEBUG [RS:1;jenkins-hbase4:40073] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40073,1696496401119' 2023-10-05 09:00:02,757 DEBUG [RS:0;jenkins-hbase4:41057] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-05 09:00:02,759 DEBUG [RS:2;jenkins-hbase4:35953] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-05 09:00:02,759 DEBUG [RS:1;jenkins-hbase4:40073] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-05 09:00:02,759 INFO [RS:2;jenkins-hbase4:35953] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-05 09:00:02,759 INFO [RS:2;jenkins-hbase4:35953] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-05 09:00:02,759 DEBUG [RS:0;jenkins-hbase4:41057] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-05 09:00:02,760 DEBUG [RS:0;jenkins-hbase4:41057] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-05 09:00:02,760 DEBUG [RS:0;jenkins-hbase4:41057] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:02,760 DEBUG [RS:0;jenkins-hbase4:41057] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41057,1696496401070' 2023-10-05 09:00:02,760 DEBUG [RS:0;jenkins-hbase4:41057] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:02,761 DEBUG [RS:1;jenkins-hbase4:40073] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-05 09:00:02,761 DEBUG [RS:0;jenkins-hbase4:41057] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:02,761 DEBUG [RS:1;jenkins-hbase4:40073] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-05 09:00:02,761 DEBUG [RS:1;jenkins-hbase4:40073] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-05 09:00:02,761 DEBUG [RS:1;jenkins-hbase4:40073] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:02,761 DEBUG [RS:1;jenkins-hbase4:40073] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40073,1696496401119' 2023-10-05 09:00:02,762 DEBUG [RS:1;jenkins-hbase4:40073] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:02,761 DEBUG [RS:0;jenkins-hbase4:41057] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-05 09:00:02,762 INFO [RS:0;jenkins-hbase4:41057] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-05 09:00:02,762 INFO [RS:0;jenkins-hbase4:41057] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-05 09:00:02,764 DEBUG [RS:1;jenkins-hbase4:40073] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:02,764 DEBUG [RS:1;jenkins-hbase4:40073] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-05 09:00:02,764 INFO [RS:1;jenkins-hbase4:40073] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-05 09:00:02,764 INFO [RS:1;jenkins-hbase4:40073] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-05 09:00:02,855 DEBUG [jenkins-hbase4:37915] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-10-05 09:00:02,860 DEBUG [jenkins-hbase4:37915] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 09:00:02,867 DEBUG [jenkins-hbase4:37915] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 09:00:02,867 DEBUG [jenkins-hbase4:37915] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 09:00:02,867 DEBUG [jenkins-hbase4:37915] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 09:00:02,867 DEBUG [jenkins-hbase4:37915] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 09:00:02,870 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41057,1696496401070, state=OPENING 2023-10-05 09:00:02,871 INFO [RS:0;jenkins-hbase4:41057] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41057%2C1696496401070, suffix=, logDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/WALs/jenkins-hbase4.apache.org,41057,1696496401070, archiveDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/oldWALs, maxLogs=32 2023-10-05 09:00:02,871 INFO [RS:1;jenkins-hbase4:40073] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40073%2C1696496401119, suffix=, logDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/WALs/jenkins-hbase4.apache.org,40073,1696496401119, archiveDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/oldWALs, maxLogs=32 2023-10-05 09:00:02,872 INFO [RS:2;jenkins-hbase4:35953] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35953%2C1696496401154, suffix=, logDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/WALs/jenkins-hbase4.apache.org,35953,1696496401154, archiveDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/oldWALs, maxLogs=32 2023-10-05 09:00:02,880 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-05 09:00:02,883 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 09:00:02,884 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-05 09:00:02,890 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41057,1696496401070}] 2023-10-05 09:00:02,924 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45003,DS-79a5c6e0-9772-45b7-b13c-d3288d91fe54,DISK] 2023-10-05 09:00:02,926 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35179,DS-982b4e12-2a00-4b1c-95d3-a7165dc3634a,DISK] 2023-10-05 09:00:02,927 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43503,DS-f60e74d0-7c69-4769-8384-725db370650c,DISK] 2023-10-05 09:00:02,927 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35179,DS-982b4e12-2a00-4b1c-95d3-a7165dc3634a,DISK] 2023-10-05 09:00:02,927 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45003,DS-79a5c6e0-9772-45b7-b13c-d3288d91fe54,DISK] 2023-10-05 09:00:02,929 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35179,DS-982b4e12-2a00-4b1c-95d3-a7165dc3634a,DISK] 2023-10-05 09:00:02,929 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43503,DS-f60e74d0-7c69-4769-8384-725db370650c,DISK] 2023-10-05 09:00:02,931 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43503,DS-f60e74d0-7c69-4769-8384-725db370650c,DISK] 2023-10-05 09:00:02,938 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45003,DS-79a5c6e0-9772-45b7-b13c-d3288d91fe54,DISK] 2023-10-05 09:00:02,951 INFO [RS:0;jenkins-hbase4:41057] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/WALs/jenkins-hbase4.apache.org,41057,1696496401070/jenkins-hbase4.apache.org%2C41057%2C1696496401070.1696496402876 2023-10-05 09:00:02,952 DEBUG [RS:0;jenkins-hbase4:41057] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35179,DS-982b4e12-2a00-4b1c-95d3-a7165dc3634a,DISK], DatanodeInfoWithStorage[127.0.0.1:45003,DS-79a5c6e0-9772-45b7-b13c-d3288d91fe54,DISK], DatanodeInfoWithStorage[127.0.0.1:43503,DS-f60e74d0-7c69-4769-8384-725db370650c,DISK]] 2023-10-05 09:00:02,954 INFO [RS:1;jenkins-hbase4:40073] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/WALs/jenkins-hbase4.apache.org,40073,1696496401119/jenkins-hbase4.apache.org%2C40073%2C1696496401119.1696496402876 2023-10-05 09:00:02,957 INFO [RS:2;jenkins-hbase4:35953] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/WALs/jenkins-hbase4.apache.org,35953,1696496401154/jenkins-hbase4.apache.org%2C35953%2C1696496401154.1696496402876 2023-10-05 09:00:02,962 DEBUG [RS:1;jenkins-hbase4:40073] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43503,DS-f60e74d0-7c69-4769-8384-725db370650c,DISK], DatanodeInfoWithStorage[127.0.0.1:45003,DS-79a5c6e0-9772-45b7-b13c-d3288d91fe54,DISK], DatanodeInfoWithStorage[127.0.0.1:35179,DS-982b4e12-2a00-4b1c-95d3-a7165dc3634a,DISK]] 2023-10-05 09:00:02,962 DEBUG [RS:2;jenkins-hbase4:35953] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45003,DS-79a5c6e0-9772-45b7-b13c-d3288d91fe54,DISK], DatanodeInfoWithStorage[127.0.0.1:43503,DS-f60e74d0-7c69-4769-8384-725db370650c,DISK], DatanodeInfoWithStorage[127.0.0.1:35179,DS-982b4e12-2a00-4b1c-95d3-a7165dc3634a,DISK]] 2023-10-05 09:00:03,129 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:03,131 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 09:00:03,135 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44644, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 09:00:03,150 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-05 09:00:03,150 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 09:00:03,154 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41057%2C1696496401070.meta, suffix=.meta, logDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/WALs/jenkins-hbase4.apache.org,41057,1696496401070, archiveDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/oldWALs, maxLogs=32 2023-10-05 09:00:03,173 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43503,DS-f60e74d0-7c69-4769-8384-725db370650c,DISK] 2023-10-05 09:00:03,175 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35179,DS-982b4e12-2a00-4b1c-95d3-a7165dc3634a,DISK] 2023-10-05 09:00:03,177 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45003,DS-79a5c6e0-9772-45b7-b13c-d3288d91fe54,DISK] 2023-10-05 09:00:03,189 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/WALs/jenkins-hbase4.apache.org,41057,1696496401070/jenkins-hbase4.apache.org%2C41057%2C1696496401070.meta.1696496403155.meta 2023-10-05 09:00:03,190 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43503,DS-f60e74d0-7c69-4769-8384-725db370650c,DISK], DatanodeInfoWithStorage[127.0.0.1:35179,DS-982b4e12-2a00-4b1c-95d3-a7165dc3634a,DISK], DatanodeInfoWithStorage[127.0.0.1:45003,DS-79a5c6e0-9772-45b7-b13c-d3288d91fe54,DISK]] 2023-10-05 09:00:03,191 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-05 09:00:03,198 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-10-05 09:00:03,200 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 09:00:03,201 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-05 09:00:03,204 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-05 09:00:03,206 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-05 09:00:03,225 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-05 09:00:03,226 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:00:03,226 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-05 09:00:03,226 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-05 09:00:03,229 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-05 09:00:03,231 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/1588230740/info 2023-10-05 09:00:03,231 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/1588230740/info 2023-10-05 09:00:03,232 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-05 09:00:03,233 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 09:00:03,233 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-05 09:00:03,235 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/1588230740/rep_barrier 2023-10-05 09:00:03,235 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/1588230740/rep_barrier 2023-10-05 09:00:03,235 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-05 09:00:03,236 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 09:00:03,236 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-05 09:00:03,238 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/1588230740/table 2023-10-05 09:00:03,238 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/1588230740/table 2023-10-05 09:00:03,238 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-05 09:00:03,239 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 09:00:03,241 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/1588230740 2023-10-05 09:00:03,244 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/1588230740 2023-10-05 09:00:03,247 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-05 09:00:03,250 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-05 09:00:03,252 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72560097, jitterRate=0.08122970163822174}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-05 09:00:03,254 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-05 09:00:03,264 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1696496403120 2023-10-05 09:00:03,283 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-05 09:00:03,284 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-05 09:00:03,284 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41057,1696496401070, state=OPEN 2023-10-05 09:00:03,287 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-05 09:00:03,288 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-05 09:00:03,297 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-05 09:00:03,297 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41057,1696496401070 in 398 msec 2023-10-05 09:00:03,304 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-05 09:00:03,304 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 621 msec 2023-10-05 09:00:03,315 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 984 msec 2023-10-05 09:00:03,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1696496403315, completionTime=-1 2023-10-05 09:00:03,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-10-05 09:00:03,316 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-10-05 09:00:03,400 DEBUG [hconnection-0x5555080-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:00:03,406 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:00:03,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-10-05 09:00:03,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1696496463436 2023-10-05 09:00:03,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1696496523436 2023-10-05 09:00:03,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 120 msec 2023-10-05 09:00:03,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37915,1696496399783-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 09:00:03,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37915,1696496399783-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-05 09:00:03,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37915,1696496399783-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-05 09:00:03,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37915, period=300000, unit=MILLISECONDS is enabled. 2023-10-05 09:00:03,467 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-05 09:00:03,474 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-05 09:00:03,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-05 09:00:03,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-05 09:00:03,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-05 09:00:03,499 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 09:00:03,505 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 09:00:03,532 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/hbase/namespace/44bd4d94cbec1f6f51e791a78c3b441b 2023-10-05 09:00:03,535 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/hbase/namespace/44bd4d94cbec1f6f51e791a78c3b441b empty. 2023-10-05 09:00:03,536 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/hbase/namespace/44bd4d94cbec1f6f51e791a78c3b441b 2023-10-05 09:00:03,536 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-05 09:00:03,581 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-05 09:00:03,584 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 44bd4d94cbec1f6f51e791a78c3b441b, NAME => 'hbase:namespace,,1696496403485.44bd4d94cbec1f6f51e791a78c3b441b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp 2023-10-05 09:00:03,612 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696496403485.44bd4d94cbec1f6f51e791a78c3b441b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:00:03,612 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 44bd4d94cbec1f6f51e791a78c3b441b, disabling compactions & flushes 2023-10-05 09:00:03,612 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696496403485.44bd4d94cbec1f6f51e791a78c3b441b. 2023-10-05 09:00:03,612 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696496403485.44bd4d94cbec1f6f51e791a78c3b441b. 2023-10-05 09:00:03,612 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696496403485.44bd4d94cbec1f6f51e791a78c3b441b. after waiting 0 ms 2023-10-05 09:00:03,612 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696496403485.44bd4d94cbec1f6f51e791a78c3b441b. 2023-10-05 09:00:03,612 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696496403485.44bd4d94cbec1f6f51e791a78c3b441b. 2023-10-05 09:00:03,612 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 44bd4d94cbec1f6f51e791a78c3b441b: 2023-10-05 09:00:03,618 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 09:00:03,639 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1696496403485.44bd4d94cbec1f6f51e791a78c3b441b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696496403621"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496403621"}]},"ts":"1696496403621"} 2023-10-05 09:00:03,673 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-05 09:00:03,675 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 09:00:03,681 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496403675"}]},"ts":"1696496403675"} 2023-10-05 09:00:03,686 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-05 09:00:03,691 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 09:00:03,692 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 09:00:03,692 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 09:00:03,692 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 09:00:03,692 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 09:00:03,695 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=44bd4d94cbec1f6f51e791a78c3b441b, ASSIGN}] 2023-10-05 09:00:03,699 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=44bd4d94cbec1f6f51e791a78c3b441b, ASSIGN 2023-10-05 09:00:03,700 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=44bd4d94cbec1f6f51e791a78c3b441b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41057,1696496401070; forceNewPlan=false, retain=false 2023-10-05 09:00:03,853 INFO [jenkins-hbase4:37915] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-05 09:00:03,854 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=44bd4d94cbec1f6f51e791a78c3b441b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:03,854 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1696496403485.44bd4d94cbec1f6f51e791a78c3b441b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696496403854"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496403854"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496403854"}]},"ts":"1696496403854"} 2023-10-05 09:00:03,860 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 44bd4d94cbec1f6f51e791a78c3b441b, server=jenkins-hbase4.apache.org,41057,1696496401070}] 2023-10-05 09:00:04,022 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1696496403485.44bd4d94cbec1f6f51e791a78c3b441b. 2023-10-05 09:00:04,022 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 44bd4d94cbec1f6f51e791a78c3b441b, NAME => 'hbase:namespace,,1696496403485.44bd4d94cbec1f6f51e791a78c3b441b.', STARTKEY => '', ENDKEY => ''} 2023-10-05 09:00:04,022 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1696496403485.44bd4d94cbec1f6f51e791a78c3b441b. service=AccessControlService 2023-10-05 09:00:04,023 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 09:00:04,024 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 44bd4d94cbec1f6f51e791a78c3b441b 2023-10-05 09:00:04,024 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696496403485.44bd4d94cbec1f6f51e791a78c3b441b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:00:04,024 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 44bd4d94cbec1f6f51e791a78c3b441b 2023-10-05 09:00:04,024 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 44bd4d94cbec1f6f51e791a78c3b441b 2023-10-05 09:00:04,026 INFO [StoreOpener-44bd4d94cbec1f6f51e791a78c3b441b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 44bd4d94cbec1f6f51e791a78c3b441b 2023-10-05 09:00:04,029 DEBUG [StoreOpener-44bd4d94cbec1f6f51e791a78c3b441b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/namespace/44bd4d94cbec1f6f51e791a78c3b441b/info 2023-10-05 09:00:04,029 DEBUG [StoreOpener-44bd4d94cbec1f6f51e791a78c3b441b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/namespace/44bd4d94cbec1f6f51e791a78c3b441b/info 2023-10-05 09:00:04,030 INFO [StoreOpener-44bd4d94cbec1f6f51e791a78c3b441b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 44bd4d94cbec1f6f51e791a78c3b441b columnFamilyName info 2023-10-05 09:00:04,030 INFO [StoreOpener-44bd4d94cbec1f6f51e791a78c3b441b-1] regionserver.HStore(310): Store=44bd4d94cbec1f6f51e791a78c3b441b/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 09:00:04,033 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/namespace/44bd4d94cbec1f6f51e791a78c3b441b 2023-10-05 09:00:04,034 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/namespace/44bd4d94cbec1f6f51e791a78c3b441b 2023-10-05 09:00:04,039 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 44bd4d94cbec1f6f51e791a78c3b441b 2023-10-05 09:00:04,043 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/namespace/44bd4d94cbec1f6f51e791a78c3b441b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 09:00:04,044 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 44bd4d94cbec1f6f51e791a78c3b441b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66450186, jitterRate=-0.009815067052841187}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 09:00:04,044 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 44bd4d94cbec1f6f51e791a78c3b441b: 2023-10-05 09:00:04,046 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1696496403485.44bd4d94cbec1f6f51e791a78c3b441b., pid=6, masterSystemTime=1696496404014 2023-10-05 09:00:04,049 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1696496403485.44bd4d94cbec1f6f51e791a78c3b441b. 2023-10-05 09:00:04,049 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1696496403485.44bd4d94cbec1f6f51e791a78c3b441b. 2023-10-05 09:00:04,051 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=44bd4d94cbec1f6f51e791a78c3b441b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:04,051 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1696496403485.44bd4d94cbec1f6f51e791a78c3b441b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696496404050"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696496404050"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696496404050"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696496404050"}]},"ts":"1696496404050"} 2023-10-05 09:00:04,060 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-05 09:00:04,060 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 44bd4d94cbec1f6f51e791a78c3b441b, server=jenkins-hbase4.apache.org,41057,1696496401070 in 196 msec 2023-10-05 09:00:04,064 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-05 09:00:04,065 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=44bd4d94cbec1f6f51e791a78c3b441b, ASSIGN in 365 msec 2023-10-05 09:00:04,066 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 09:00:04,066 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496404066"}]},"ts":"1696496404066"} 2023-10-05 09:00:04,069 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-05 09:00:04,073 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 09:00:04,076 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 586 msec 2023-10-05 09:00:04,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-05 09:00:04,101 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-05 09:00:04,101 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 09:00:04,137 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-05 09:00:04,155 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-05 09:00:04,164 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 33 msec 2023-10-05 09:00:04,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-05 09:00:04,182 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-05 09:00:04,188 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-10-05 09:00:04,196 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-05 09:00:04,200 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-05 09:00:04,200 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.977sec 2023-10-05 09:00:04,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-05 09:00:04,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-05 09:00:04,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-05 09:00:04,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37915,1696496399783-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-05 09:00:04,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37915,1696496399783-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-05 09:00:04,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-05 09:00:04,231 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-10-05 09:00:04,234 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 09:00:04,236 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 09:00:04,238 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/hbase/acl/0bb59e34ca1c72ee82135cd60b6409dd 2023-10-05 09:00:04,239 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/hbase/acl/0bb59e34ca1c72ee82135cd60b6409dd empty. 2023-10-05 09:00:04,240 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-10-05 09:00:04,243 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/hbase/acl/0bb59e34ca1c72ee82135cd60b6409dd 2023-10-05 09:00:04,243 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-10-05 09:00:04,251 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-05 09:00:04,268 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-10-05 09:00:04,270 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0bb59e34ca1c72ee82135cd60b6409dd, NAME => 'hbase:acl,,1696496404225.0bb59e34ca1c72ee82135cd60b6409dd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp 2023-10-05 09:00:04,299 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696496404225.0bb59e34ca1c72ee82135cd60b6409dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:00:04,299 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 0bb59e34ca1c72ee82135cd60b6409dd, disabling compactions & flushes 2023-10-05 09:00:04,299 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696496404225.0bb59e34ca1c72ee82135cd60b6409dd. 2023-10-05 09:00:04,299 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696496404225.0bb59e34ca1c72ee82135cd60b6409dd. 2023-10-05 09:00:04,299 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696496404225.0bb59e34ca1c72ee82135cd60b6409dd. after waiting 0 ms 2023-10-05 09:00:04,299 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696496404225.0bb59e34ca1c72ee82135cd60b6409dd. 2023-10-05 09:00:04,299 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1696496404225.0bb59e34ca1c72ee82135cd60b6409dd. 2023-10-05 09:00:04,299 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 0bb59e34ca1c72ee82135cd60b6409dd: 2023-10-05 09:00:04,301 DEBUG [Listener at localhost/46441] zookeeper.ReadOnlyZKClient(139): Connect 0x7a39c81f to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:00:04,306 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 09:00:04,308 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1696496404225.0bb59e34ca1c72ee82135cd60b6409dd.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696496404308"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496404308"}]},"ts":"1696496404308"} 2023-10-05 09:00:04,309 DEBUG [Listener at localhost/46441] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fbd2bdb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:00:04,311 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-05 09:00:04,315 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 09:00:04,315 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496404315"}]},"ts":"1696496404315"} 2023-10-05 09:00:04,319 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-10-05 09:00:04,324 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 09:00:04,325 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 09:00:04,325 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 09:00:04,325 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 09:00:04,325 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 09:00:04,326 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=0bb59e34ca1c72ee82135cd60b6409dd, ASSIGN}] 2023-10-05 09:00:04,326 DEBUG [hconnection-0x197b6539-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:00:04,329 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=0bb59e34ca1c72ee82135cd60b6409dd, ASSIGN 2023-10-05 09:00:04,330 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=0bb59e34ca1c72ee82135cd60b6409dd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40073,1696496401119; forceNewPlan=false, retain=false 2023-10-05 09:00:04,339 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44658, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:00:04,342 INFO [Listener at localhost/46441] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37915,1696496399783 2023-10-05 09:00:04,342 INFO [Listener at localhost/46441] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-10-05 09:00:04,343 INFO [Listener at localhost/46441] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/test.cache.data in system properties and HBase conf 2023-10-05 09:00:04,343 INFO [Listener at localhost/46441] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/hadoop.tmp.dir in system properties and HBase conf 2023-10-05 09:00:04,343 INFO [Listener at localhost/46441] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/hadoop.log.dir in system properties and HBase conf 2023-10-05 09:00:04,343 INFO [Listener at localhost/46441] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-05 09:00:04,343 INFO [Listener at localhost/46441] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-05 09:00:04,343 INFO [Listener at localhost/46441] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-05 09:00:04,343 INFO [Listener at localhost/46441] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-05 09:00:04,343 INFO [Listener at localhost/46441] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-05 09:00:04,343 INFO [Listener at localhost/46441] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-05 09:00:04,343 INFO [Listener at localhost/46441] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-05 09:00:04,343 INFO [Listener at localhost/46441] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-05 09:00:04,343 INFO [Listener at localhost/46441] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-05 09:00:04,343 INFO [Listener at localhost/46441] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-05 09:00:04,344 INFO [Listener at localhost/46441] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-05 09:00:04,344 INFO [Listener at localhost/46441] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-05 09:00:04,344 INFO [Listener at localhost/46441] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/nfs.dump.dir in system properties and HBase conf 2023-10-05 09:00:04,344 INFO [Listener at localhost/46441] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/java.io.tmpdir in system properties and HBase conf 2023-10-05 09:00:04,344 INFO [Listener at localhost/46441] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-05 09:00:04,344 INFO [Listener at localhost/46441] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-05 09:00:04,344 INFO [Listener at localhost/46441] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-10-05 09:00:04,356 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-05 09:00:04,482 INFO [jenkins-hbase4:37915] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-05 09:00:04,483 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0bb59e34ca1c72ee82135cd60b6409dd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:04,483 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1696496404225.0bb59e34ca1c72ee82135cd60b6409dd.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696496404482"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496404482"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496404482"}]},"ts":"1696496404482"} 2023-10-05 09:00:04,487 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 0bb59e34ca1c72ee82135cd60b6409dd, server=jenkins-hbase4.apache.org,40073,1696496401119}] 2023-10-05 09:00:04,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-05 09:00:04,643 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:04,643 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 09:00:04,647 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 09:00:04,655 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1696496404225.0bb59e34ca1c72ee82135cd60b6409dd. 2023-10-05 09:00:04,655 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0bb59e34ca1c72ee82135cd60b6409dd, NAME => 'hbase:acl,,1696496404225.0bb59e34ca1c72ee82135cd60b6409dd.', STARTKEY => '', ENDKEY => ''} 2023-10-05 09:00:04,656 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1696496404225.0bb59e34ca1c72ee82135cd60b6409dd. service=AccessControlService 2023-10-05 09:00:04,656 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 09:00:04,656 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 0bb59e34ca1c72ee82135cd60b6409dd 2023-10-05 09:00:04,656 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696496404225.0bb59e34ca1c72ee82135cd60b6409dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:00:04,656 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0bb59e34ca1c72ee82135cd60b6409dd 2023-10-05 09:00:04,656 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0bb59e34ca1c72ee82135cd60b6409dd 2023-10-05 09:00:04,659 INFO [StoreOpener-0bb59e34ca1c72ee82135cd60b6409dd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 0bb59e34ca1c72ee82135cd60b6409dd 2023-10-05 09:00:04,661 DEBUG [StoreOpener-0bb59e34ca1c72ee82135cd60b6409dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/acl/0bb59e34ca1c72ee82135cd60b6409dd/l 2023-10-05 09:00:04,661 DEBUG [StoreOpener-0bb59e34ca1c72ee82135cd60b6409dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/acl/0bb59e34ca1c72ee82135cd60b6409dd/l 2023-10-05 09:00:04,662 INFO [StoreOpener-0bb59e34ca1c72ee82135cd60b6409dd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0bb59e34ca1c72ee82135cd60b6409dd columnFamilyName l 2023-10-05 09:00:04,663 INFO [StoreOpener-0bb59e34ca1c72ee82135cd60b6409dd-1] regionserver.HStore(310): Store=0bb59e34ca1c72ee82135cd60b6409dd/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 09:00:04,667 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/acl/0bb59e34ca1c72ee82135cd60b6409dd 2023-10-05 09:00:04,669 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/acl/0bb59e34ca1c72ee82135cd60b6409dd 2023-10-05 09:00:04,674 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0bb59e34ca1c72ee82135cd60b6409dd 2023-10-05 09:00:04,679 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/acl/0bb59e34ca1c72ee82135cd60b6409dd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 09:00:04,680 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0bb59e34ca1c72ee82135cd60b6409dd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63726458, jitterRate=-0.050401777029037476}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 09:00:04,681 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0bb59e34ca1c72ee82135cd60b6409dd: 2023-10-05 09:00:04,682 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1696496404225.0bb59e34ca1c72ee82135cd60b6409dd., pid=11, masterSystemTime=1696496404643 2023-10-05 09:00:04,687 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1696496404225.0bb59e34ca1c72ee82135cd60b6409dd. 2023-10-05 09:00:04,689 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1696496404225.0bb59e34ca1c72ee82135cd60b6409dd. 2023-10-05 09:00:04,691 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0bb59e34ca1c72ee82135cd60b6409dd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:04,691 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1696496404225.0bb59e34ca1c72ee82135cd60b6409dd.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696496404691"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696496404691"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696496404691"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696496404691"}]},"ts":"1696496404691"} 2023-10-05 09:00:04,699 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-05 09:00:04,699 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 0bb59e34ca1c72ee82135cd60b6409dd, server=jenkins-hbase4.apache.org,40073,1696496401119 in 207 msec 2023-10-05 09:00:04,702 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-05 09:00:04,703 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=0bb59e34ca1c72ee82135cd60b6409dd, ASSIGN in 373 msec 2023-10-05 09:00:04,704 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 09:00:04,704 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496404704"}]},"ts":"1696496404704"} 2023-10-05 09:00:04,707 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-10-05 09:00:04,711 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 09:00:04,713 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 482 msec 2023-10-05 09:00:04,857 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-05 09:00:04,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-10-05 09:00:04,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-05 09:00:05,519 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 09:00:05,789 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 09:00:05,795 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34521_jobhistory____.koyehw/webapp 2023-10-05 09:00:05,943 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-10-05 09:00:05,944 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-10-05 09:00:05,944 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-05 09:00:05,946 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-05 09:00:06,015 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 09:00:06,275 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 09:00:06,546 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-10-05 09:00:06,579 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34521 2023-10-05 09:00:07,009 WARN [Listener at jenkins-hbase4.apache.org/40817] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 09:00:07,264 WARN [Listener at jenkins-hbase4.apache.org/40817] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-05 09:00:07,265 INFO [Listener at jenkins-hbase4.apache.org/40817] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 09:00:07,272 INFO [Listener at jenkins-hbase4.apache.org/40817] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41365_cluster____ja77qn/webapp 2023-10-05 09:00:07,353 INFO [Listener at jenkins-hbase4.apache.org/40817] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-10-05 09:00:07,354 INFO [Listener at jenkins-hbase4.apache.org/40817] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-10-05 09:00:07,354 INFO [Listener at jenkins-hbase4.apache.org/40817] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-05 09:00:07,354 INFO [Listener at jenkins-hbase4.apache.org/40817] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-05 09:00:07,365 INFO [Listener at jenkins-hbase4.apache.org/40817] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 09:00:07,567 INFO [Listener at jenkins-hbase4.apache.org/40817] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 09:00:07,684 INFO [Listener at jenkins-hbase4.apache.org/40817] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 09:00:07,692 INFO [Listener at jenkins-hbase4.apache.org/40817] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41365 2023-10-05 09:00:08,261 WARN [Listener at jenkins-hbase4.apache.org/37355] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 09:00:08,303 WARN [Listener at jenkins-hbase4.apache.org/37355] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-05 09:00:08,304 INFO [Listener at jenkins-hbase4.apache.org/37355] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 09:00:08,311 INFO [Listener at jenkins-hbase4.apache.org/37355] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35573_node____eg4y99/webapp 2023-10-05 09:00:08,363 INFO [Listener at jenkins-hbase4.apache.org/37355] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-05 09:00:08,364 INFO [Listener at jenkins-hbase4.apache.org/37355] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-05 09:00:08,364 INFO [Listener at jenkins-hbase4.apache.org/37355] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-05 09:00:08,364 INFO [Listener at jenkins-hbase4.apache.org/37355] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-05 09:00:08,374 INFO [Listener at jenkins-hbase4.apache.org/37355] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 09:00:08,395 INFO [Listener at jenkins-hbase4.apache.org/37355] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 09:00:08,492 INFO [Listener at jenkins-hbase4.apache.org/37355] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 09:00:08,506 INFO [Listener at jenkins-hbase4.apache.org/37355] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35573 2023-10-05 09:00:08,674 WARN [Listener at jenkins-hbase4.apache.org/41667] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 09:00:08,682 WARN [Listener at jenkins-hbase4.apache.org/41667] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-05 09:00:08,683 INFO [Listener at jenkins-hbase4.apache.org/41667] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 09:00:08,689 INFO [Listener at jenkins-hbase4.apache.org/41667] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45001_node____rmmgy6/webapp 2023-10-05 09:00:08,739 INFO [Listener at jenkins-hbase4.apache.org/41667] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-05 09:00:08,739 INFO [Listener at jenkins-hbase4.apache.org/41667] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-05 09:00:08,739 INFO [Listener at jenkins-hbase4.apache.org/41667] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-05 09:00:08,740 INFO [Listener at jenkins-hbase4.apache.org/41667] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-05 09:00:08,750 INFO [Listener at jenkins-hbase4.apache.org/41667] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 09:00:08,769 INFO [Listener at jenkins-hbase4.apache.org/41667] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 09:00:08,797 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 09:00:08,907 INFO [Listener at jenkins-hbase4.apache.org/41667] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 09:00:08,917 INFO [Listener at jenkins-hbase4.apache.org/41667] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45001 2023-10-05 09:00:08,950 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-10-05 09:00:08,952 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 09:00:09,030 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=897, MaxFileDescriptor=60000, SystemLoadAverage=287, ProcessCount=167, AvailableMemoryMB=6791 2023-10-05 09:00:09,030 WARN [Listener at jenkins-hbase4.apache.org/41667] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-10-05 09:00:09,031 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-05 09:00:09,033 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-05 09:00:09,034 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-10-05 09:00:09,048 DEBUG [Listener at jenkins-hbase4.apache.org/41667] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-05 09:00:09,053 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36360, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-05 09:00:09,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 09:00:09,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-10-05 09:00:09,066 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 09:00:09,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-10-05 09:00:09,068 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 09:00:09,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 09:00:09,072 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportWithTargetName/b1adb6952874921f5d0bfa8a84a9c3ad 2023-10-05 09:00:09,072 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportWithTargetName/ebdebfd44e539141dcf20972797adb60 2023-10-05 09:00:09,073 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportWithTargetName/b1adb6952874921f5d0bfa8a84a9c3ad empty. 2023-10-05 09:00:09,073 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportWithTargetName/ebdebfd44e539141dcf20972797adb60 empty. 2023-10-05 09:00:09,074 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportWithTargetName/b1adb6952874921f5d0bfa8a84a9c3ad 2023-10-05 09:00:09,074 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportWithTargetName/ebdebfd44e539141dcf20972797adb60 2023-10-05 09:00:09,074 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-05 09:00:09,104 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-10-05 09:00:09,106 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => b1adb6952874921f5d0bfa8a84a9c3ad, NAME => 'testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp 2023-10-05 09:00:09,107 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => ebdebfd44e539141dcf20972797adb60, NAME => 'testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp 2023-10-05 09:00:09,151 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:00:09,153 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing ebdebfd44e539141dcf20972797adb60, disabling compactions & flushes 2023-10-05 09:00:09,154 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60. 2023-10-05 09:00:09,154 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60. 2023-10-05 09:00:09,154 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60. after waiting 0 ms 2023-10-05 09:00:09,154 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60. 2023-10-05 09:00:09,154 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:00:09,154 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60. 2023-10-05 09:00:09,155 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing b1adb6952874921f5d0bfa8a84a9c3ad, disabling compactions & flushes 2023-10-05 09:00:09,155 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for ebdebfd44e539141dcf20972797adb60: 2023-10-05 09:00:09,155 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad. 2023-10-05 09:00:09,155 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad. 2023-10-05 09:00:09,155 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad. after waiting 0 ms 2023-10-05 09:00:09,155 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad. 2023-10-05 09:00:09,155 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad. 2023-10-05 09:00:09,156 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for b1adb6952874921f5d0bfa8a84a9c3ad: 2023-10-05 09:00:09,165 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 09:00:09,166 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696496409166"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496409166"}]},"ts":"1696496409166"} 2023-10-05 09:00:09,166 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696496409166"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496409166"}]},"ts":"1696496409166"} 2023-10-05 09:00:09,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 09:00:09,217 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 09:00:09,219 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 09:00:09,219 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496409219"}]},"ts":"1696496409219"} 2023-10-05 09:00:09,221 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-10-05 09:00:09,226 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 09:00:09,228 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 09:00:09,229 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 09:00:09,229 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 09:00:09,229 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 09:00:09,229 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1adb6952874921f5d0bfa8a84a9c3ad, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ebdebfd44e539141dcf20972797adb60, ASSIGN}] 2023-10-05 09:00:09,234 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ebdebfd44e539141dcf20972797adb60, ASSIGN 2023-10-05 09:00:09,234 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1adb6952874921f5d0bfa8a84a9c3ad, ASSIGN 2023-10-05 09:00:09,236 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1adb6952874921f5d0bfa8a84a9c3ad, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35953,1696496401154; forceNewPlan=false, retain=false 2023-10-05 09:00:09,236 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ebdebfd44e539141dcf20972797adb60, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41057,1696496401070; forceNewPlan=false, retain=false 2023-10-05 09:00:09,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 09:00:09,386 INFO [jenkins-hbase4:37915] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 09:00:09,389 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=b1adb6952874921f5d0bfa8a84a9c3ad, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:09,389 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=ebdebfd44e539141dcf20972797adb60, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:09,389 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696496409389"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496409389"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496409389"}]},"ts":"1696496409389"} 2023-10-05 09:00:09,389 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696496409389"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496409389"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496409389"}]},"ts":"1696496409389"} 2023-10-05 09:00:09,392 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure b1adb6952874921f5d0bfa8a84a9c3ad, server=jenkins-hbase4.apache.org,35953,1696496401154}] 2023-10-05 09:00:09,393 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure ebdebfd44e539141dcf20972797adb60, server=jenkins-hbase4.apache.org,41057,1696496401070}] 2023-10-05 09:00:09,546 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:09,547 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 09:00:09,550 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49246, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 09:00:09,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad. 2023-10-05 09:00:09,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b1adb6952874921f5d0bfa8a84a9c3ad, NAME => 'testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 09:00:09,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad. service=AccessControlService 2023-10-05 09:00:09,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 09:00:09,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName b1adb6952874921f5d0bfa8a84a9c3ad 2023-10-05 09:00:09,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:00:09,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60. 2023-10-05 09:00:09,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b1adb6952874921f5d0bfa8a84a9c3ad 2023-10-05 09:00:09,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b1adb6952874921f5d0bfa8a84a9c3ad 2023-10-05 09:00:09,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ebdebfd44e539141dcf20972797adb60, NAME => 'testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 09:00:09,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60. service=AccessControlService 2023-10-05 09:00:09,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 09:00:09,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName ebdebfd44e539141dcf20972797adb60 2023-10-05 09:00:09,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:00:09,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ebdebfd44e539141dcf20972797adb60 2023-10-05 09:00:09,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ebdebfd44e539141dcf20972797adb60 2023-10-05 09:00:09,560 INFO [StoreOpener-b1adb6952874921f5d0bfa8a84a9c3ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b1adb6952874921f5d0bfa8a84a9c3ad 2023-10-05 09:00:09,564 INFO [StoreOpener-ebdebfd44e539141dcf20972797adb60-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ebdebfd44e539141dcf20972797adb60 2023-10-05 09:00:09,566 DEBUG [StoreOpener-b1adb6952874921f5d0bfa8a84a9c3ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportWithTargetName/b1adb6952874921f5d0bfa8a84a9c3ad/cf 2023-10-05 09:00:09,566 DEBUG [StoreOpener-b1adb6952874921f5d0bfa8a84a9c3ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportWithTargetName/b1adb6952874921f5d0bfa8a84a9c3ad/cf 2023-10-05 09:00:09,566 DEBUG [StoreOpener-ebdebfd44e539141dcf20972797adb60-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportWithTargetName/ebdebfd44e539141dcf20972797adb60/cf 2023-10-05 09:00:09,566 DEBUG [StoreOpener-ebdebfd44e539141dcf20972797adb60-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportWithTargetName/ebdebfd44e539141dcf20972797adb60/cf 2023-10-05 09:00:09,570 INFO [StoreOpener-b1adb6952874921f5d0bfa8a84a9c3ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b1adb6952874921f5d0bfa8a84a9c3ad columnFamilyName cf 2023-10-05 09:00:09,570 INFO [StoreOpener-ebdebfd44e539141dcf20972797adb60-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ebdebfd44e539141dcf20972797adb60 columnFamilyName cf 2023-10-05 09:00:09,572 INFO [StoreOpener-b1adb6952874921f5d0bfa8a84a9c3ad-1] regionserver.HStore(310): Store=b1adb6952874921f5d0bfa8a84a9c3ad/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 09:00:09,572 INFO [StoreOpener-ebdebfd44e539141dcf20972797adb60-1] regionserver.HStore(310): Store=ebdebfd44e539141dcf20972797adb60/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 09:00:09,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportWithTargetName/b1adb6952874921f5d0bfa8a84a9c3ad 2023-10-05 09:00:09,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportWithTargetName/ebdebfd44e539141dcf20972797adb60 2023-10-05 09:00:09,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportWithTargetName/b1adb6952874921f5d0bfa8a84a9c3ad 2023-10-05 09:00:09,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportWithTargetName/ebdebfd44e539141dcf20972797adb60 2023-10-05 09:00:09,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ebdebfd44e539141dcf20972797adb60 2023-10-05 09:00:09,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b1adb6952874921f5d0bfa8a84a9c3ad 2023-10-05 09:00:09,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportWithTargetName/b1adb6952874921f5d0bfa8a84a9c3ad/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 09:00:09,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportWithTargetName/ebdebfd44e539141dcf20972797adb60/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 09:00:09,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ebdebfd44e539141dcf20972797adb60; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62367189, jitterRate=-0.07065646350383759}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 09:00:09,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b1adb6952874921f5d0bfa8a84a9c3ad; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64477309, jitterRate=-0.03921322524547577}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 09:00:09,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ebdebfd44e539141dcf20972797adb60: 2023-10-05 09:00:09,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b1adb6952874921f5d0bfa8a84a9c3ad: 2023-10-05 09:00:09,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad., pid=15, masterSystemTime=1696496409546 2023-10-05 09:00:09,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60., pid=16, masterSystemTime=1696496409546 2023-10-05 09:00:09,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad. 2023-10-05 09:00:09,601 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad. 2023-10-05 09:00:09,602 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=b1adb6952874921f5d0bfa8a84a9c3ad, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:09,603 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696496409602"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696496409602"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696496409602"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696496409602"}]},"ts":"1696496409602"} 2023-10-05 09:00:09,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60. 2023-10-05 09:00:09,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60. 2023-10-05 09:00:09,606 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=ebdebfd44e539141dcf20972797adb60, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:09,607 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696496409606"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696496409606"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696496409606"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696496409606"}]},"ts":"1696496409606"} 2023-10-05 09:00:09,614 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-10-05 09:00:09,614 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure b1adb6952874921f5d0bfa8a84a9c3ad, server=jenkins-hbase4.apache.org,35953,1696496401154 in 216 msec 2023-10-05 09:00:09,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-10-05 09:00:09,620 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure ebdebfd44e539141dcf20972797adb60, server=jenkins-hbase4.apache.org,41057,1696496401070 in 218 msec 2023-10-05 09:00:09,620 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1adb6952874921f5d0bfa8a84a9c3ad, ASSIGN in 385 msec 2023-10-05 09:00:09,624 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-10-05 09:00:09,624 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ebdebfd44e539141dcf20972797adb60, ASSIGN in 388 msec 2023-10-05 09:00:09,625 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 09:00:09,625 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496409625"}]},"ts":"1696496409625"} 2023-10-05 09:00:09,627 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-10-05 09:00:09,630 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 09:00:09,635 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-10-05 09:00:09,641 DEBUG [PEWorker-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:00:09,644 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58624, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:00:09,647 DEBUG [hconnection-0x25dba544-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:00:09,650 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-10-05 09:00:09,658 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40073] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-05 09:00:09,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 09:00:09,689 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-05 09:00:09,689 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-05 09:00:09,689 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-05 09:00:09,689 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-05 09:00:09,690 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 09:00:09,697 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-05 09:00:09,697 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-05 09:00:09,697 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-05 09:00:09,697 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-05 09:00:09,700 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 636 msec 2023-10-05 09:00:09,946 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 09:00:09,947 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-10-05 09:00:09,947 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 09:00:09,947 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-10-05 09:00:09,947 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-05 09:00:09,948 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-10-05 09:00:09,948 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 09:00:09,948 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-10-05 09:00:09,948 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-05 09:00:09,948 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-05 09:00:10,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 09:00:10,176 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-10-05 09:00:10,180 DEBUG [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-05 09:00:10,181 DEBUG [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad. 2023-10-05 09:00:10,184 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 09:00:10,209 DEBUG [hconnection-0x197b6539-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:00:10,214 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:00:10,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 09:00:10,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696496410231 (current time:1696496410231). 2023-10-05 09:00:10,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 09:00:10,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(139): Connect 0x10b13d92 to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:00:10,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15fa2a11, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:00:10,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:00:10,243 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44262, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:00:10,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10b13d92 to 127.0.0.1:63699 2023-10-05 09:00:10,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:00:10,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(139): Connect 0x09af24de to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:00:10,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@453b67f1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:00:10,255 DEBUG [hconnection-0x3dbc1367-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:00:10,256 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44268, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:00:10,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:00:10,262 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58638, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:00:10,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09af24de to 127.0.0.1:63699 2023-10-05 09:00:10,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:00:10,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-05 09:00:10,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 09:00:10,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 09:00:10,302 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot, current working dir path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 09:00:10,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 09:00:10,323 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 09:00:10,324 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696497010324 2023-10-05 09:00:10,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 09:00:10,325 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-05 09:00:10,327 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 09:00:10,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 09:00:10,330 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-10-05 09:00:10,331 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 09:00:10,332 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696497010332 2023-10-05 09:00:10,332 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 09:00:10,332 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 09:00:10,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,361 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-10-05 09:00:10,361 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:00:10,361 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-10-05 09:00:10,362 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-05 09:00:10,362 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,362 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,369 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:10,369 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:10,369 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:10,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:10,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:10,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:10,369 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:10,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:10,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:10,369 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:10,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:10,369 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:10,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,370 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:10,370 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 09:00:10,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-05 09:00:10,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,371 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 09:00:10,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-05 09:00:10,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-05 09:00:10,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,372 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 09:00:10,373 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 09:00:10,380 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,380 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,380 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,380 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 09:00:10,380 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 09:00:10,380 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:00:10,380 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 09:00:10,380 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:00:10,381 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:00:10,381 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 09:00:10,383 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 09:00:10,382 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 09:00:10,383 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-05 09:00:10,383 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-05 09:00:10,383 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-05 09:00:10,383 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41057,1696496401070' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-05 09:00:10,383 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40073,1696496401119' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-05 09:00:10,383 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35953,1696496401154' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-05 09:00:10,385 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,385 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,385 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,385 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:10,386 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:10,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:10,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:10,386 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,386 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,386 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:00:10,386 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,386 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:00:10,386 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:00:10,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:10,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:10,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:10,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:10,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:10,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:10,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:10,389 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41057,1696496401070' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-05 09:00:10,389 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@398b7780[Count = 1] remaining members to acquire global barrier 2023-10-05 09:00:10,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:10,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:10,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:10,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:10,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:10,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:10,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:10,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:10,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:10,393 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35953,1696496401154' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-05 09:00:10,393 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@398b7780[Count = 0] remaining members to acquire global barrier 2023-10-05 09:00:10,393 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-05 09:00:10,393 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,395 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,395 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,395 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,395 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 09:00:10,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,395 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:10,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,395 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 09:00:10,395 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 09:00:10,396 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-05 09:00:10,396 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40073,1696496401119' in zk 2023-10-05 09:00:10,396 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:10,396 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 09:00:10,396 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 09:00:10,396 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 09:00:10,396 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60. 2023-10-05 09:00:10,396 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 09:00:10,397 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 09:00:10,397 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad. 2023-10-05 09:00:10,397 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60. started... 2023-10-05 09:00:10,397 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad. started... 2023-10-05 09:00:10,400 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 09:00:10,400 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:00:10,400 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-05 09:00:10,402 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ebdebfd44e539141dcf20972797adb60: 2023-10-05 09:00:10,402 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b1adb6952874921f5d0bfa8a84a9c3ad: 2023-10-05 09:00:10,403 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,403 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,411 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 09:00:10,411 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 09:00:10,416 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 09:00:10,416 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 09:00:10,432 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:00:10,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 09:00:10,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-05 09:00:10,439 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 09:00:10,452 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60. completed. 2023-10-05 09:00:10,452 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60. 2023-10-05 09:00:10,453 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 09:00:10,453 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 09:00:10,453 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:10,453 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-05 09:00:10,453 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41057,1696496401070' in zk 2023-10-05 09:00:10,455 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 09:00:10,455 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:10,455 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:00:10,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:10,455 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-05 09:00:10,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:10,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:10,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:10,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:10,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:10,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:10,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:10,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:10,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:10,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:10,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,41057,1696496401070': 2023-10-05 09:00:10,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41057,1696496401070' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-05 09:00:10,639 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:00:10,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 09:00:10,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-05 09:00:10,641 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-05 09:00:10,853 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad. completed. 2023-10-05 09:00:10,854 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad. 2023-10-05 09:00:10,854 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 09:00:10,854 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 09:00:10,854 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:10,854 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-05 09:00:10,854 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35953,1696496401154' in zk 2023-10-05 09:00:10,856 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:10,856 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 09:00:10,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:10,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:10,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:10,856 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:00:10,856 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-05 09:00:10,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:10,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:10,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:10,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:10,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:10,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:10,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:10,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:10,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:10,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35953,1696496401154': 2023-10-05 09:00:10,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35953,1696496401154' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-05 09:00:10,863 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-10-05 09:00:10,863 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 09:00:10,863 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 09:00:10,863 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,863 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 09:00:10,866 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,866 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,866 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:10,866 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:10,866 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,866 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:10,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:10,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:10,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,866 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:10,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:10,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:10,867 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:10,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:10,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:10,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:10,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:10,868 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:10,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,868 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:10,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:10,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:10,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:10,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:10,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:10,870 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:10,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,871 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:10,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:10,871 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:10,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:10,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:10,887 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:10,887 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:10,888 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:10,888 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:10,888 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:10,888 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:10,888 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:10,888 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:10,888 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:00:10,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:10,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:10,888 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:10,888 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:10,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:10,889 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,888 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:10,889 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-05 09:00:10,889 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:10,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:10,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:10,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:10,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:10,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:10,890 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 09:00:10,890 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:10,890 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:10,890 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,890 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:10,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:10,891 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 09:00:10,911 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,914 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,941 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:00:10,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 09:00:10,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-05 09:00:10,944 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-05 09:00:10,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,965 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-05 09:00:10,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,966 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:10,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696496410325Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696496410911 (+586 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1696496410911Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1696496410912 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1696496410924 (+12 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1696496410952 (+28 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696496410965 (+13 ms) 2023-10-05 09:00:10,968 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 09:00:10,970 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 641 msec 2023-10-05 09:00:11,445 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:00:11,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 09:00:11,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 09:00:11,460 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35953] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 09:00:11,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41057] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 09:00:11,466 DEBUG [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-05 09:00:11,466 DEBUG [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad. 2023-10-05 09:00:11,467 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 09:00:11,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 09:00:11,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696496411481 (current time:1696496411481). 2023-10-05 09:00:11,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 09:00:11,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(139): Connect 0x1148ed92 to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:00:11,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c9f798b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:00:11,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:00:11,494 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44280, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:00:11,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1148ed92 to 127.0.0.1:63699 2023-10-05 09:00:11,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:00:11,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(139): Connect 0x094f8eb3 to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:00:11,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5fbdc675, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:00:11,503 DEBUG [hconnection-0x7849bf28-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:00:11,506 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44292, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:00:11,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:00:11,511 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58642, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:00:11,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x094f8eb3 to 127.0.0.1:63699 2023-10-05 09:00:11,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:00:11,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-05 09:00:11,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 09:00:11,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 09:00:11,517 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot, current working dir path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 09:00:11,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 09:00:11,520 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 09:00:11,521 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696497011521 2023-10-05 09:00:11,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 09:00:11,521 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-05 09:00:11,522 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 09:00:11,522 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 09:00:11,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 09:00:11,523 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 09:00:11,525 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-10-05 09:00:11,526 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 09:00:11,527 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696497011527 2023-10-05 09:00:11,546 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-10-05 09:00:11,546 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-10-05 09:00:11,546 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:00:11,546 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-10-05 09:00:11,546 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-05 09:00:11,547 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,547 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,548 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:11,548 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:11,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:11,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:11,548 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:11,548 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:11,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:11,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:11,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:11,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:11,549 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:11,549 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:11,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,550 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:11,550 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 09:00:11,550 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,550 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,550 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-05 09:00:11,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-05 09:00:11,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-05 09:00:11,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,550 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 09:00:11,550 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 09:00:11,550 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 09:00:11,551 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-05 09:00:11,551 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 09:00:11,551 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:00:11,551 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 09:00:11,551 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-05 09:00:11,552 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-05 09:00:11,552 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-05 09:00:11,554 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 09:00:11,552 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 09:00:11,555 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:00:11,554 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40073,1696496401119' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-05 09:00:11,555 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 09:00:11,555 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:00:11,555 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-05 09:00:11,556 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 09:00:11,556 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-05 09:00:11,556 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35953,1696496401154' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-05 09:00:11,556 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41057,1696496401070' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-05 09:00:11,559 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,559 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:11,559 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,559 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:11,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:11,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:11,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:11,559 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,559 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,560 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,560 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:00:11,560 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:00:11,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:11,560 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,560 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:00:11,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:11,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 09:00:11,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:11,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:11,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:11,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:11,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35953,1696496401154' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-05 09:00:11,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36442b4d[Count = 1] remaining members to acquire global barrier 2023-10-05 09:00:11,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:11,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:11,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:11,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:11,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:11,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 09:00:11,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:11,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:11,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:11,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:11,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41057,1696496401070' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-05 09:00:11,565 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36442b4d[Count = 0] remaining members to acquire global barrier 2023-10-05 09:00:11,565 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-05 09:00:11,565 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,571 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,571 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,571 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,572 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 09:00:11,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,572 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:11,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,572 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 09:00:11,572 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 09:00:11,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,572 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 09:00:11,572 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 09:00:11,572 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad. 2023-10-05 09:00:11,572 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:11,572 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 09:00:11,572 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad. started... 2023-10-05 09:00:11,572 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60. 2023-10-05 09:00:11,572 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-05 09:00:11,572 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60. started... 2023-10-05 09:00:11,572 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40073,1696496401119' in zk 2023-10-05 09:00:11,572 INFO [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b1adb6952874921f5d0bfa8a84a9c3ad 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-05 09:00:11,572 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 09:00:11,573 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 09:00:11,573 INFO [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ebdebfd44e539141dcf20972797adb60 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-05 09:00:11,575 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 09:00:11,575 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:00:11,575 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-05 09:00:11,622 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:00:11,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 09:00:11,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-05 09:00:11,624 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 09:00:11,708 INFO [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100562aabc6f62c343929578c820fb56a1cd to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100562aabc6f62c343929578c820fb56a1cd 2023-10-05 09:00:11,708 INFO [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231005561b309f6d8442c18a022d4ef5707adc to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231005561b309f6d8442c18a022d4ef5707adc 2023-10-05 09:00:11,745 INFO [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportWithTargetName/b1adb6952874921f5d0bfa8a84a9c3ad/.tmp/cf/055ff42ff88244819724da78d3b0c5e2 2023-10-05 09:00:11,746 INFO [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportWithTargetName/ebdebfd44e539141dcf20972797adb60/.tmp/cf/8521b80902414ebabe8f7838dac498bf 2023-10-05 09:00:11,760 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportWithTargetName/b1adb6952874921f5d0bfa8a84a9c3ad/.tmp/cf/055ff42ff88244819724da78d3b0c5e2 as hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportWithTargetName/b1adb6952874921f5d0bfa8a84a9c3ad/cf/055ff42ff88244819724da78d3b0c5e2 2023-10-05 09:00:11,760 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportWithTargetName/ebdebfd44e539141dcf20972797adb60/.tmp/cf/8521b80902414ebabe8f7838dac498bf as hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportWithTargetName/ebdebfd44e539141dcf20972797adb60/cf/8521b80902414ebabe8f7838dac498bf 2023-10-05 09:00:11,769 INFO [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportWithTargetName/b1adb6952874921f5d0bfa8a84a9c3ad/cf/055ff42ff88244819724da78d3b0c5e2, entries=4, sequenceid=6, filesize=5.6 K 2023-10-05 09:00:11,770 INFO [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportWithTargetName/ebdebfd44e539141dcf20972797adb60/cf/8521b80902414ebabe8f7838dac498bf, entries=46, sequenceid=6, filesize=12.6 K 2023-10-05 09:00:11,774 INFO [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for b1adb6952874921f5d0bfa8a84a9c3ad in 202ms, sequenceid=6, compaction requested=false 2023-10-05 09:00:11,774 INFO [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for ebdebfd44e539141dcf20972797adb60 in 201ms, sequenceid=6, compaction requested=false 2023-10-05 09:00:11,774 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-05 09:00:11,774 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-05 09:00:11,776 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ebdebfd44e539141dcf20972797adb60: 2023-10-05 09:00:11,776 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b1adb6952874921f5d0bfa8a84a9c3ad: 2023-10-05 09:00:11,777 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-05 09:00:11,777 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 09:00:11,777 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-05 09:00:11,777 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportWithTargetName/ebdebfd44e539141dcf20972797adb60/cf/8521b80902414ebabe8f7838dac498bf] hfiles 2023-10-05 09:00:11,777 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 09:00:11,777 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportWithTargetName/ebdebfd44e539141dcf20972797adb60/cf/8521b80902414ebabe8f7838dac498bf for snapshot=snaptb0-testExportWithTargetName 2023-10-05 09:00:11,777 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportWithTargetName/b1adb6952874921f5d0bfa8a84a9c3ad/cf/055ff42ff88244819724da78d3b0c5e2] hfiles 2023-10-05 09:00:11,777 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportWithTargetName/b1adb6952874921f5d0bfa8a84a9c3ad/cf/055ff42ff88244819724da78d3b0c5e2 for snapshot=snaptb0-testExportWithTargetName 2023-10-05 09:00:11,805 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad. completed. 2023-10-05 09:00:11,805 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60. completed. 2023-10-05 09:00:11,805 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad. 2023-10-05 09:00:11,805 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60. 2023-10-05 09:00:11,805 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 09:00:11,805 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 09:00:11,805 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 09:00:11,805 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:11,805 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 09:00:11,805 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-05 09:00:11,805 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:11,805 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41057,1696496401070' in zk 2023-10-05 09:00:11,805 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-05 09:00:11,806 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35953,1696496401154' in zk 2023-10-05 09:00:11,807 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 09:00:11,807 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:11,807 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:00:11,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:11,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:11,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:11,807 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-05 09:00:11,808 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 09:00:11,808 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:11,808 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:00:11,808 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-05 09:00:11,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:11,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:11,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 09:00:11,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:11,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:11,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:11,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:11,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 09:00:11,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:11,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:11,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:11,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,41057,1696496401070': 2023-10-05 09:00:11,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41057,1696496401070' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-05 09:00:11,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:11,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:11,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:11,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:11,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:11,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 09:00:11,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:11,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:11,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:11,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:11,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 09:00:11,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:11,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:11,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:11,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35953,1696496401154': 2023-10-05 09:00:11,819 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35953,1696496401154' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-05 09:00:11,819 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-10-05 09:00:11,819 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 09:00:11,819 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 09:00:11,819 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-10-05 09:00:11,819 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 09:00:11,823 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,823 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:11,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:11,823 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,823 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:11,823 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,823 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:11,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:11,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:11,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:11,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,823 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:11,824 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:11,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:11,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 09:00:11,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:11,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:11,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:11,824 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:00:11,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:11,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,824 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:11,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 09:00:11,826 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:11,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:11,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 09:00:11,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-05 09:00:11,826 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-05 09:00:11,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:11,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:11,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:11,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 09:00:11,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:11,829 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:11,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:11,829 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:11,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:11,830 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:11,841 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:11,841 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:11,841 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:11,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:11,841 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:11,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:11,841 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:11,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:11,841 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:11,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:11,842 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:11,842 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,842 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:11,842 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,842 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:11,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:11,842 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:11,842 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,842 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,842 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:11,842 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:11,843 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:11,843 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:00:11,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:11,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:11,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:11,843 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-10-05 09:00:11,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:11,844 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-05 09:00:11,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:11,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:11,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-05 09:00:11,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 09:00:11,846 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100562aabc6f62c343929578c820fb56a1cd, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231005561b309f6d8442c18a022d4ef5707adc] mob files 2023-10-05 09:00:11,846 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100562aabc6f62c343929578c820fb56a1cd 2023-10-05 09:00:11,846 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231005561b309f6d8442c18a022d4ef5707adc 2023-10-05 09:00:11,862 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-10-05 09:00:11,863 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,899 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,900 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-05 09:00:11,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,901 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-05 09:00:11,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696496411521Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696496411862 (+341 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1696496411862Loading Region manifests for snaptb0-testExportWithTargetName at 1696496411863 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1696496411868 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1696496411889 (+21 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696496411900 (+11 ms) 2023-10-05 09:00:11,903 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 09:00:11,906 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 382 msec 2023-10-05 09:00:12,127 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:00:12,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 09:00:12,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 09:00:12,130 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496412130 2023-10-05 09:00:12,131 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45983, tgtDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496412130, rawTgtDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496412130, srcFsUri=hdfs://localhost:45983, srcDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c 2023-10-05 09:00:12,170 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45983, inputRoot=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c 2023-10-05 09:00:12,170 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1196385270_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496412130, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496412130/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-05 09:00:12,170 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45983, inputRoot=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c, snapshotDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-10-05 09:00:12,188 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496412130/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-05 09:00:12,259 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:12,260 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:12,260 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:12,261 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:12,262 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:12,262 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:12,262 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:12,353 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/hadoop-793277576783622086.jar 2023-10-05 09:00:12,354 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:12,354 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:12,355 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:12,355 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:12,356 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:12,356 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:12,356 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 09:00:12,357 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 09:00:12,357 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 09:00:12,358 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 09:00:12,358 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 09:00:12,359 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 09:00:12,359 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 09:00:12,359 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 09:00:12,360 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 09:00:12,360 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 09:00:12,363 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:00:12,364 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:00:12,364 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 09:00:12,364 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:00:12,365 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:00:12,365 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 09:00:12,365 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 09:00:13,115 WARN [Listener at jenkins-hbase4.apache.org/41667] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 09:00:13,122 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-10-05 09:00:13,133 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-05 09:00:13,559 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 09:00:13,561 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 09:00:13,753 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0001_000001 (auth:SIMPLE) 2023-10-05 09:00:15,061 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 09:00:18,095 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0001_000001 (auth:SIMPLE) 2023-10-05 09:00:20,334 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0001_000001 (auth:SIMPLE) 2023-10-05 09:00:23,005 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0001_000001 (auth:SIMPLE) 2023-10-05 09:00:24,945 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 09:00:24,948 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 09:00:24,960 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-10-05 09:00:24,960 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 09:00:24,961 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 09:00:24,961 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_795266163_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-05 09:00:24,962 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-10-05 09:00:24,962 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-10-05 09:00:24,962 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_795266163_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496412130/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496412130/.hbase-snapshot/testExportWithTargetName 2023-10-05 09:00:24,962 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496412130/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-10-05 09:00:24,962 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496412130/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-10-05 09:00:24,973 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-10-05 09:00:24,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-10-05 09:00:24,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-10-05 09:00:24,991 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496424991"}]},"ts":"1696496424991"} 2023-10-05 09:00:24,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-05 09:00:24,993 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-10-05 09:00:24,995 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-10-05 09:00:24,997 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1adb6952874921f5d0bfa8a84a9c3ad, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ebdebfd44e539141dcf20972797adb60, UNASSIGN}] 2023-10-05 09:00:25,000 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1adb6952874921f5d0bfa8a84a9c3ad, UNASSIGN 2023-10-05 09:00:25,000 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ebdebfd44e539141dcf20972797adb60, UNASSIGN 2023-10-05 09:00:25,001 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=ebdebfd44e539141dcf20972797adb60, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:25,001 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=b1adb6952874921f5d0bfa8a84a9c3ad, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:25,001 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696496425001"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496425001"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496425001"}]},"ts":"1696496425001"} 2023-10-05 09:00:25,001 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696496425001"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496425001"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496425001"}]},"ts":"1696496425001"} 2023-10-05 09:00:25,003 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure ebdebfd44e539141dcf20972797adb60, server=jenkins-hbase4.apache.org,41057,1696496401070}] 2023-10-05 09:00:25,004 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure b1adb6952874921f5d0bfa8a84a9c3ad, server=jenkins-hbase4.apache.org,35953,1696496401154}] 2023-10-05 09:00:25,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-05 09:00:25,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b1adb6952874921f5d0bfa8a84a9c3ad 2023-10-05 09:00:25,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ebdebfd44e539141dcf20972797adb60 2023-10-05 09:00:25,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ebdebfd44e539141dcf20972797adb60, disabling compactions & flushes 2023-10-05 09:00:25,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b1adb6952874921f5d0bfa8a84a9c3ad, disabling compactions & flushes 2023-10-05 09:00:25,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60. 2023-10-05 09:00:25,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad. 2023-10-05 09:00:25,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60. 2023-10-05 09:00:25,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad. 2023-10-05 09:00:25,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60. after waiting 0 ms 2023-10-05 09:00:25,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad. after waiting 0 ms 2023-10-05 09:00:25,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60. 2023-10-05 09:00:25,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad. 2023-10-05 09:00:25,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportWithTargetName/ebdebfd44e539141dcf20972797adb60/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 09:00:25,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportWithTargetName/b1adb6952874921f5d0bfa8a84a9c3ad/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 09:00:25,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 09:00:25,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 09:00:25,180 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad. 2023-10-05 09:00:25,180 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60. 2023-10-05 09:00:25,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b1adb6952874921f5d0bfa8a84a9c3ad: 2023-10-05 09:00:25,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ebdebfd44e539141dcf20972797adb60: 2023-10-05 09:00:25,183 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ebdebfd44e539141dcf20972797adb60 2023-10-05 09:00:25,183 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=ebdebfd44e539141dcf20972797adb60, regionState=CLOSED 2023-10-05 09:00:25,184 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696496425183"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496425183"}]},"ts":"1696496425183"} 2023-10-05 09:00:25,184 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b1adb6952874921f5d0bfa8a84a9c3ad 2023-10-05 09:00:25,185 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=b1adb6952874921f5d0bfa8a84a9c3ad, regionState=CLOSED 2023-10-05 09:00:25,185 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696496425184"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496425184"}]},"ts":"1696496425184"} 2023-10-05 09:00:25,188 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-10-05 09:00:25,188 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure ebdebfd44e539141dcf20972797adb60, server=jenkins-hbase4.apache.org,41057,1696496401070 in 182 msec 2023-10-05 09:00:25,190 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=22 2023-10-05 09:00:25,190 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure b1adb6952874921f5d0bfa8a84a9c3ad, server=jenkins-hbase4.apache.org,35953,1696496401154 in 183 msec 2023-10-05 09:00:25,191 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ebdebfd44e539141dcf20972797adb60, UNASSIGN in 191 msec 2023-10-05 09:00:25,192 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-10-05 09:00:25,192 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1adb6952874921f5d0bfa8a84a9c3ad, UNASSIGN in 193 msec 2023-10-05 09:00:25,193 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496425193"}]},"ts":"1696496425193"} 2023-10-05 09:00:25,195 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-10-05 09:00:25,196 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-10-05 09:00:25,200 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 217 msec 2023-10-05 09:00:25,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-05 09:00:25,296 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-10-05 09:00:25,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-10-05 09:00:25,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 09:00:25,310 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 09:00:25,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-10-05 09:00:25,312 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 09:00:25,315 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40073] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-10-05 09:00:25,319 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportWithTargetName/b1adb6952874921f5d0bfa8a84a9c3ad 2023-10-05 09:00:25,319 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportWithTargetName/ebdebfd44e539141dcf20972797adb60 2023-10-05 09:00:25,320 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 09:00:25,320 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 09:00:25,320 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 09:00:25,320 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 09:00:25,321 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:00:25,321 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:00:25,321 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-05 09:00:25,321 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-05 09:00:25,321 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:00:25,321 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:00:25,322 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 09:00:25,322 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 09:00:25,322 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-05 09:00:25,322 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 09:00:25,322 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-05 09:00:25,322 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 09:00:25,323 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportWithTargetName/ebdebfd44e539141dcf20972797adb60/cf, FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportWithTargetName/ebdebfd44e539141dcf20972797adb60/recovered.edits] 2023-10-05 09:00:25,323 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportWithTargetName/b1adb6952874921f5d0bfa8a84a9c3ad/cf, FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportWithTargetName/b1adb6952874921f5d0bfa8a84a9c3ad/recovered.edits] 2023-10-05 09:00:25,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-05 09:00:25,331 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportWithTargetName/ebdebfd44e539141dcf20972797adb60/cf/8521b80902414ebabe8f7838dac498bf to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportWithTargetName/ebdebfd44e539141dcf20972797adb60/cf/8521b80902414ebabe8f7838dac498bf 2023-10-05 09:00:25,331 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportWithTargetName/b1adb6952874921f5d0bfa8a84a9c3ad/cf/055ff42ff88244819724da78d3b0c5e2 to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportWithTargetName/b1adb6952874921f5d0bfa8a84a9c3ad/cf/055ff42ff88244819724da78d3b0c5e2 2023-10-05 09:00:25,336 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportWithTargetName/ebdebfd44e539141dcf20972797adb60/recovered.edits/9.seqid to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportWithTargetName/ebdebfd44e539141dcf20972797adb60/recovered.edits/9.seqid 2023-10-05 09:00:25,336 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportWithTargetName/b1adb6952874921f5d0bfa8a84a9c3ad/recovered.edits/9.seqid to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportWithTargetName/b1adb6952874921f5d0bfa8a84a9c3ad/recovered.edits/9.seqid 2023-10-05 09:00:25,337 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportWithTargetName/ebdebfd44e539141dcf20972797adb60 2023-10-05 09:00:25,337 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportWithTargetName/b1adb6952874921f5d0bfa8a84a9c3ad 2023-10-05 09:00:25,337 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-05 09:00:25,337 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-05 09:00:25,338 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-10-05 09:00:25,342 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100562aabc6f62c343929578c820fb56a1cd to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100562aabc6f62c343929578c820fb56a1cd 2023-10-05 09:00:25,344 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231005561b309f6d8442c18a022d4ef5707adc to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231005561b309f6d8442c18a022d4ef5707adc 2023-10-05 09:00:25,345 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-05 09:00:25,348 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 09:00:25,370 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-10-05 09:00:25,373 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-10-05 09:00:25,375 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 09:00:25,375 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-10-05 09:00:25,375 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696496425375"}]},"ts":"9223372036854775807"} 2023-10-05 09:00:25,375 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696496425375"}]},"ts":"9223372036854775807"} 2023-10-05 09:00:25,377 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 09:00:25,377 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b1adb6952874921f5d0bfa8a84a9c3ad, NAME => 'testtb-testExportWithTargetName,,1696496409060.b1adb6952874921f5d0bfa8a84a9c3ad.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ebdebfd44e539141dcf20972797adb60, NAME => 'testtb-testExportWithTargetName,1,1696496409060.ebdebfd44e539141dcf20972797adb60.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 09:00:25,377 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-10-05 09:00:25,378 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696496425378"}]},"ts":"9223372036854775807"} 2023-10-05 09:00:25,380 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-10-05 09:00:25,382 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 09:00:25,384 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 80 msec 2023-10-05 09:00:25,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-05 09:00:25,428 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-10-05 09:00:25,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-10-05 09:00:25,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-10-05 09:00:25,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-10-05 09:00:25,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportWithTargetName 2023-10-05 09:00:25,485 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=754 (was 706) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/cluster_b0202d10-b338-417a-fd42-e9b01be8eb27/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_795266163_17 at /127.0.0.1:48164 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_795266163_17 at /127.0.0.1:37316 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:37355 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:46643 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5555080-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5555080-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_795266163_17 at /127.0.0.1:51846 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/cluster_b0202d10-b338-417a-fd42-e9b01be8eb27/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/cluster_b0202d10-b338-417a-fd42-e9b01be8eb27/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/cluster_b0202d10-b338-417a-fd42-e9b01be8eb27/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5555080-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:36527 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/cluster_b0202d10-b338-417a-fd42-e9b01be8eb27/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/cluster_b0202d10-b338-417a-fd42-e9b01be8eb27/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_484175916_1 at /127.0.0.1:48142 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_484175916_1 at /127.0.0.1:51822 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5555080-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1280 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=931 (was 897) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=281 (was 287), ProcessCount=167 (was 167), AvailableMemoryMB=6064 (was 6791) 2023-10-05 09:00:25,486 WARN [Listener at jenkins-hbase4.apache.org/41667] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-10-05 09:00:25,506 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=754, OpenFileDescriptor=931, MaxFileDescriptor=60000, SystemLoadAverage=281, ProcessCount=167, AvailableMemoryMB=6063 2023-10-05 09:00:25,506 WARN [Listener at jenkins-hbase4.apache.org/41667] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-10-05 09:00:25,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 09:00:25,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-10-05 09:00:25,513 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 09:00:25,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-10-05 09:00:25,515 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 09:00:25,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-05 09:00:25,517 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemState/c223c58452330420ade8b3fde4201990 2023-10-05 09:00:25,517 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemState/b5d2f1981b1712e2dc9d479511a949a1 2023-10-05 09:00:25,518 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemState/c223c58452330420ade8b3fde4201990 empty. 2023-10-05 09:00:25,518 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemState/b5d2f1981b1712e2dc9d479511a949a1 empty. 2023-10-05 09:00:25,518 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemState/c223c58452330420ade8b3fde4201990 2023-10-05 09:00:25,518 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemState/b5d2f1981b1712e2dc9d479511a949a1 2023-10-05 09:00:25,518 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-05 09:00:25,535 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-05 09:00:25,537 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => b5d2f1981b1712e2dc9d479511a949a1, NAME => 'testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp 2023-10-05 09:00:25,537 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => c223c58452330420ade8b3fde4201990, NAME => 'testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp 2023-10-05 09:00:25,566 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:00:25,566 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing c223c58452330420ade8b3fde4201990, disabling compactions & flushes 2023-10-05 09:00:25,566 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990. 2023-10-05 09:00:25,567 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990. 2023-10-05 09:00:25,567 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990. after waiting 0 ms 2023-10-05 09:00:25,567 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990. 2023-10-05 09:00:25,567 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990. 2023-10-05 09:00:25,567 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for c223c58452330420ade8b3fde4201990: 2023-10-05 09:00:25,567 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:00:25,568 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing b5d2f1981b1712e2dc9d479511a949a1, disabling compactions & flushes 2023-10-05 09:00:25,568 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1. 2023-10-05 09:00:25,568 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1. 2023-10-05 09:00:25,568 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1. after waiting 0 ms 2023-10-05 09:00:25,568 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1. 2023-10-05 09:00:25,568 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1. 2023-10-05 09:00:25,568 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for b5d2f1981b1712e2dc9d479511a949a1: 2023-10-05 09:00:25,571 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 09:00:25,572 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696496425572"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496425572"}]},"ts":"1696496425572"} 2023-10-05 09:00:25,572 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696496425572"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496425572"}]},"ts":"1696496425572"} 2023-10-05 09:00:25,575 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 09:00:25,576 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 09:00:25,576 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496425576"}]},"ts":"1696496425576"} 2023-10-05 09:00:25,578 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-10-05 09:00:25,582 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 09:00:25,583 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 09:00:25,583 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 09:00:25,583 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 09:00:25,583 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 09:00:25,584 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c223c58452330420ade8b3fde4201990, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b5d2f1981b1712e2dc9d479511a949a1, ASSIGN}] 2023-10-05 09:00:25,586 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b5d2f1981b1712e2dc9d479511a949a1, ASSIGN 2023-10-05 09:00:25,586 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c223c58452330420ade8b3fde4201990, ASSIGN 2023-10-05 09:00:25,587 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b5d2f1981b1712e2dc9d479511a949a1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35953,1696496401154; forceNewPlan=false, retain=false 2023-10-05 09:00:25,587 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c223c58452330420ade8b3fde4201990, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41057,1696496401070; forceNewPlan=false, retain=false 2023-10-05 09:00:25,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-05 09:00:25,737 INFO [jenkins-hbase4:37915] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 09:00:25,740 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c223c58452330420ade8b3fde4201990, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:25,740 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=b5d2f1981b1712e2dc9d479511a949a1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:25,740 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696496425740"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496425740"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496425740"}]},"ts":"1696496425740"} 2023-10-05 09:00:25,740 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696496425740"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496425740"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496425740"}]},"ts":"1696496425740"} 2023-10-05 09:00:25,742 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure c223c58452330420ade8b3fde4201990, server=jenkins-hbase4.apache.org,41057,1696496401070}] 2023-10-05 09:00:25,743 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure b5d2f1981b1712e2dc9d479511a949a1, server=jenkins-hbase4.apache.org,35953,1696496401154}] 2023-10-05 09:00:25,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-05 09:00:25,899 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1. 2023-10-05 09:00:25,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990. 2023-10-05 09:00:25,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b5d2f1981b1712e2dc9d479511a949a1, NAME => 'testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 09:00:25,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c223c58452330420ade8b3fde4201990, NAME => 'testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 09:00:25,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1. service=AccessControlService 2023-10-05 09:00:25,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 09:00:25,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990. service=AccessControlService 2023-10-05 09:00:25,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState b5d2f1981b1712e2dc9d479511a949a1 2023-10-05 09:00:25,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:00:25,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 09:00:25,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b5d2f1981b1712e2dc9d479511a949a1 2023-10-05 09:00:25,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState c223c58452330420ade8b3fde4201990 2023-10-05 09:00:25,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b5d2f1981b1712e2dc9d479511a949a1 2023-10-05 09:00:25,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:00:25,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c223c58452330420ade8b3fde4201990 2023-10-05 09:00:25,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c223c58452330420ade8b3fde4201990 2023-10-05 09:00:25,902 INFO [StoreOpener-b5d2f1981b1712e2dc9d479511a949a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b5d2f1981b1712e2dc9d479511a949a1 2023-10-05 09:00:25,902 INFO [StoreOpener-c223c58452330420ade8b3fde4201990-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c223c58452330420ade8b3fde4201990 2023-10-05 09:00:25,904 DEBUG [StoreOpener-b5d2f1981b1712e2dc9d479511a949a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemState/b5d2f1981b1712e2dc9d479511a949a1/cf 2023-10-05 09:00:25,904 DEBUG [StoreOpener-b5d2f1981b1712e2dc9d479511a949a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemState/b5d2f1981b1712e2dc9d479511a949a1/cf 2023-10-05 09:00:25,904 DEBUG [StoreOpener-c223c58452330420ade8b3fde4201990-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemState/c223c58452330420ade8b3fde4201990/cf 2023-10-05 09:00:25,904 DEBUG [StoreOpener-c223c58452330420ade8b3fde4201990-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemState/c223c58452330420ade8b3fde4201990/cf 2023-10-05 09:00:25,904 INFO [StoreOpener-c223c58452330420ade8b3fde4201990-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c223c58452330420ade8b3fde4201990 columnFamilyName cf 2023-10-05 09:00:25,904 INFO [StoreOpener-b5d2f1981b1712e2dc9d479511a949a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5d2f1981b1712e2dc9d479511a949a1 columnFamilyName cf 2023-10-05 09:00:25,906 INFO [StoreOpener-b5d2f1981b1712e2dc9d479511a949a1-1] regionserver.HStore(310): Store=b5d2f1981b1712e2dc9d479511a949a1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 09:00:25,906 INFO [StoreOpener-c223c58452330420ade8b3fde4201990-1] regionserver.HStore(310): Store=c223c58452330420ade8b3fde4201990/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 09:00:25,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemState/b5d2f1981b1712e2dc9d479511a949a1 2023-10-05 09:00:25,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemState/c223c58452330420ade8b3fde4201990 2023-10-05 09:00:25,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemState/b5d2f1981b1712e2dc9d479511a949a1 2023-10-05 09:00:25,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemState/c223c58452330420ade8b3fde4201990 2023-10-05 09:00:25,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c223c58452330420ade8b3fde4201990 2023-10-05 09:00:25,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b5d2f1981b1712e2dc9d479511a949a1 2023-10-05 09:00:25,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemState/c223c58452330420ade8b3fde4201990/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 09:00:25,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemState/b5d2f1981b1712e2dc9d479511a949a1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 09:00:25,915 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c223c58452330420ade8b3fde4201990; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66876130, jitterRate=-0.0034680068492889404}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 09:00:25,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c223c58452330420ade8b3fde4201990: 2023-10-05 09:00:25,916 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b5d2f1981b1712e2dc9d479511a949a1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62360237, jitterRate=-0.07076005637645721}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 09:00:25,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b5d2f1981b1712e2dc9d479511a949a1: 2023-10-05 09:00:25,916 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990., pid=30, masterSystemTime=1696496425895 2023-10-05 09:00:25,917 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1., pid=31, masterSystemTime=1696496425896 2023-10-05 09:00:25,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990. 2023-10-05 09:00:25,918 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990. 2023-10-05 09:00:25,919 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c223c58452330420ade8b3fde4201990, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:25,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1. 2023-10-05 09:00:25,919 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1. 2023-10-05 09:00:25,919 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696496425919"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696496425919"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696496425919"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696496425919"}]},"ts":"1696496425919"} 2023-10-05 09:00:25,921 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=b5d2f1981b1712e2dc9d479511a949a1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:25,921 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696496425921"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696496425921"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696496425921"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696496425921"}]},"ts":"1696496425921"} 2023-10-05 09:00:25,927 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-10-05 09:00:25,928 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-10-05 09:00:25,928 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure c223c58452330420ade8b3fde4201990, server=jenkins-hbase4.apache.org,41057,1696496401070 in 181 msec 2023-10-05 09:00:25,930 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure b5d2f1981b1712e2dc9d479511a949a1, server=jenkins-hbase4.apache.org,35953,1696496401154 in 181 msec 2023-10-05 09:00:25,931 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b5d2f1981b1712e2dc9d479511a949a1, ASSIGN in 344 msec 2023-10-05 09:00:25,932 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-10-05 09:00:25,932 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c223c58452330420ade8b3fde4201990, ASSIGN in 344 msec 2023-10-05 09:00:25,933 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 09:00:25,933 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496425933"}]},"ts":"1696496425933"} 2023-10-05 09:00:25,935 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-10-05 09:00:25,938 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 09:00:25,938 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-10-05 09:00:25,942 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40073] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 09:00:25,943 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:00:25,943 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:00:25,943 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:00:25,943 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:00:25,945 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 09:00:25,945 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 09:00:25,946 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 09:00:25,946 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 09:00:25,948 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 435 msec 2023-10-05 09:00:26,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-05 09:00:26,119 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-10-05 09:00:26,122 DEBUG [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-05 09:00:26,123 DEBUG [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990. 2023-10-05 09:00:26,125 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 09:00:26,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 09:00:26,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696496426141 (current time:1696496426141). 2023-10-05 09:00:26,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 09:00:26,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(139): Connect 0x31c2dd13 to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:00:26,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7306cf73, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:00:26,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:00:26,152 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58386, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:00:26,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x31c2dd13 to 127.0.0.1:63699 2023-10-05 09:00:26,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:00:26,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(139): Connect 0x0c7d3b1d to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:00:26,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bf045c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:00:26,160 DEBUG [hconnection-0x6e486a9e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:00:26,163 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:00:26,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:00:26,170 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53348, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:00:26,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c7d3b1d to 127.0.0.1:63699 2023-10-05 09:00:26,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:00:26,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 09:00:26,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 09:00:26,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 09:00:26,177 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot, current working dir path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 09:00:26,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 09:00:26,179 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 09:00:26,180 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696497026180 2023-10-05 09:00:26,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 09:00:26,180 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-05 09:00:26,181 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 09:00:26,182 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 09:00:26,183 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 09:00:26,183 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 09:00:26,184 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-10-05 09:00:26,185 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 09:00:26,186 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696497026186 2023-10-05 09:00:26,200 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,200 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-10-05 09:00:26,200 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:00:26,201 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-10-05 09:00:26,201 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-05 09:00:26,201 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,201 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,204 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:26,204 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:26,204 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:26,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:26,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:26,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:26,204 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:26,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:26,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:26,205 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,205 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,206 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,206 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,206 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,206 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 09:00:26,206 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-05 09:00:26,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-05 09:00:26,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-05 09:00:26,207 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 09:00:26,206 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 09:00:26,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,207 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,207 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 09:00:26,207 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 09:00:26,207 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:00:26,208 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 09:00:26,208 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-05 09:00:26,208 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41057,1696496401070' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-05 09:00:26,208 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,208 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,208 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 09:00:26,208 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 09:00:26,208 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:00:26,208 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:00:26,209 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 09:00:26,209 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-05 09:00:26,210 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 09:00:26,210 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-05 09:00:26,210 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35953,1696496401154' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-05 09:00:26,210 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40073,1696496401119' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-05 09:00:26,211 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,211 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:26,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:26,218 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,218 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,218 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,218 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:00:26,219 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,219 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,219 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:00:26,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:26,219 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,219 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:00:26,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:26,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:26,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:26,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41057,1696496401070' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-05 09:00:26,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@768f1c14[Count = 1] remaining members to acquire global barrier 2023-10-05 09:00:26,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:26,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:26,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:26,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:26,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:26,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:26,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35953,1696496401154' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-05 09:00:26,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@768f1c14[Count = 0] remaining members to acquire global barrier 2023-10-05 09:00:26,224 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-05 09:00:26,224 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,226 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,226 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,226 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,226 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 09:00:26,226 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,227 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 09:00:26,227 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 09:00:26,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,227 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1. 2023-10-05 09:00:26,227 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 09:00:26,227 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 09:00:26,227 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-05 09:00:26,227 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1. started... 2023-10-05 09:00:26,227 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40073,1696496401119' in zk 2023-10-05 09:00:26,227 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,227 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 09:00:26,229 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 09:00:26,230 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990. 2023-10-05 09:00:26,230 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 09:00:26,230 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b5d2f1981b1712e2dc9d479511a949a1: 2023-10-05 09:00:26,230 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 09:00:26,230 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990. started... 2023-10-05 09:00:26,231 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:00:26,231 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-05 09:00:26,231 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,232 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c223c58452330420ade8b3fde4201990: 2023-10-05 09:00:26,232 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 09:00:26,232 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 09:00:26,232 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,232 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 09:00:26,232 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 09:00:26,256 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990. completed. 2023-10-05 09:00:26,256 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990. 2023-10-05 09:00:26,256 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 09:00:26,257 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 09:00:26,257 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,257 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-05 09:00:26,257 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41057,1696496401070' in zk 2023-10-05 09:00:26,259 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1. completed. 2023-10-05 09:00:26,259 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1. 2023-10-05 09:00:26,260 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 09:00:26,260 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 09:00:26,260 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,260 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-05 09:00:26,260 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35953,1696496401154' in zk 2023-10-05 09:00:26,260 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,260 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 09:00:26,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:26,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:26,260 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:00:26,260 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-05 09:00:26,261 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 09:00:26,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:26,261 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,261 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:00:26,262 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-05 09:00:26,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:26,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:26,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:26,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:26,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41057,1696496401070': 2023-10-05 09:00:26,266 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41057,1696496401070' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-05 09:00:26,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:26,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:26,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:26,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:26,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:26,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:26,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:26,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35953,1696496401154': 2023-10-05 09:00:26,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35953,1696496401154' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-05 09:00:26,270 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-10-05 09:00:26,270 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 09:00:26,270 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 09:00:26,270 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,270 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 09:00:26,272 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,272 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:26,272 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,272 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:26,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:26,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,272 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:26,272 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,273 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:26,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:26,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:26,273 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:26,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:26,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:26,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:26,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:26,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,274 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:26,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,275 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:26,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:26,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:26,277 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,277 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,278 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:26,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:26,281 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:26,281 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,281 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,281 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:26,281 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:26,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:26,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:26,281 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:26,282 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:00:26,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:26,282 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:00:26,281 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:26,281 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:26,281 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:26,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:26,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:26,282 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,284 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-05 09:00:26,282 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:26,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:26,284 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:26,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:26,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:26,284 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:26,284 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,284 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,284 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,285 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,285 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,284 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 09:00:26,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 09:00:26,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-05 09:00:26,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:26,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:26,285 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 09:00:26,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 09:00:26,301 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,329 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,330 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-05 09:00:26,330 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,330 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:26,330 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696496426180Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696496426301 (+121 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1696496426301Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1696496426301Writing data manifest for emptySnaptb0-testExportFileSystemState at 1696496426309 (+8 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1696496426322 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696496426330 (+8 ms) 2023-10-05 09:00:26,333 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 09:00:26,335 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 152 msec 2023-10-05 09:00:26,485 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:00:26,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 09:00:26,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 09:00:26,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41057] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 09:00:26,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35953] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 09:00:26,498 DEBUG [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-05 09:00:26,498 DEBUG [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990. 2023-10-05 09:00:26,498 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 09:00:26,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 09:00:26,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696496426511 (current time:1696496426511). 2023-10-05 09:00:26,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 09:00:26,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(139): Connect 0x3ffb7b7b to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:00:26,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3fa33cfd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:00:26,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:00:26,525 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58414, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:00:26,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ffb7b7b to 127.0.0.1:63699 2023-10-05 09:00:26,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:00:26,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(139): Connect 0x773bfff3 to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:00:26,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@351de08a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:00:26,537 DEBUG [hconnection-0x76679828-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:00:26,538 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58426, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:00:26,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:00:26,543 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53358, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:00:26,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x773bfff3 to 127.0.0.1:63699 2023-10-05 09:00:26,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:00:26,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 09:00:26,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 09:00:26,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 09:00:26,548 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot, current working dir path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 09:00:26,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 09:00:26,551 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 09:00:26,552 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696497026552 2023-10-05 09:00:26,552 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-05 09:00:26,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 09:00:26,554 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 09:00:26,554 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 09:00:26,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 09:00:26,555 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 09:00:26,557 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-10-05 09:00:26,558 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 09:00:26,558 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696497026558 2023-10-05 09:00:26,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-10-05 09:00:26,574 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-10-05 09:00:26,575 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:00:26,576 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-10-05 09:00:26,576 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-05 09:00:26,577 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,577 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,579 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:26,579 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:26,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:26,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:26,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:26,579 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:26,579 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:26,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:26,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:26,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,580 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,580 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,580 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,580 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,580 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,580 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 09:00:26,580 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-05 09:00:26,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-05 09:00:26,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,581 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 09:00:26,581 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 09:00:26,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-05 09:00:26,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,581 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 09:00:26,581 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-05 09:00:26,581 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-05 09:00:26,581 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 09:00:26,581 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-05 09:00:26,581 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:00:26,581 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 09:00:26,582 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 09:00:26,582 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-05 09:00:26,581 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 09:00:26,583 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35953,1696496401154' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-05 09:00:26,582 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:00:26,583 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:00:26,584 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 09:00:26,584 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-05 09:00:26,584 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 09:00:26,584 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41057,1696496401070' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-05 09:00:26,585 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-05 09:00:26,585 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40073,1696496401119' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-05 09:00:26,586 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,586 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:26,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:26,587 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,587 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,587 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:26,587 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:00:26,587 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,587 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,587 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:00:26,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:26,587 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,587 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:00:26,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 09:00:26,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:26,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:26,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35953,1696496401154' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-05 09:00:26,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@145a4232[Count = 1] remaining members to acquire global barrier 2023-10-05 09:00:26,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:26,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:26,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:26,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:26,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 09:00:26,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:26,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:26,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41057,1696496401070' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-05 09:00:26,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@145a4232[Count = 0] remaining members to acquire global barrier 2023-10-05 09:00:26,591 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-05 09:00:26,591 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,592 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,592 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,592 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,592 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 09:00:26,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,593 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 09:00:26,593 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 09:00:26,592 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,593 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1. 2023-10-05 09:00:26,593 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-05 09:00:26,593 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 09:00:26,593 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 09:00:26,593 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990. 2023-10-05 09:00:26,593 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 09:00:26,593 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 09:00:26,593 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40073,1696496401119' in zk 2023-10-05 09:00:26,593 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,593 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 09:00:26,593 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1. started... 2023-10-05 09:00:26,593 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990. started... 2023-10-05 09:00:26,594 INFO [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c223c58452330420ade8b3fde4201990 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-05 09:00:26,594 INFO [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b5d2f1981b1712e2dc9d479511a949a1 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-05 09:00:26,599 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 09:00:26,599 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:00:26,599 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-05 09:00:26,643 INFO [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023100590185c9edae34cde8b16c8b5c842884c to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100590185c9edae34cde8b16c8b5c842884c 2023-10-05 09:00:26,647 INFO [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310055651123f33924fe4b40fb452a6c030cd to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310055651123f33924fe4b40fb452a6c030cd 2023-10-05 09:00:26,654 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:00:26,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 09:00:26,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-05 09:00:26,662 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 09:00:26,665 INFO [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemState/c223c58452330420ade8b3fde4201990/.tmp/cf/fcc9a94374bf4d1da2cbe0b5e25ac21d 2023-10-05 09:00:26,669 INFO [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemState/b5d2f1981b1712e2dc9d479511a949a1/.tmp/cf/ff8496c789284bc4a77f2111f071f472 2023-10-05 09:00:26,674 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemState/c223c58452330420ade8b3fde4201990/.tmp/cf/fcc9a94374bf4d1da2cbe0b5e25ac21d as hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemState/c223c58452330420ade8b3fde4201990/cf/fcc9a94374bf4d1da2cbe0b5e25ac21d 2023-10-05 09:00:26,677 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemState/b5d2f1981b1712e2dc9d479511a949a1/.tmp/cf/ff8496c789284bc4a77f2111f071f472 as hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemState/b5d2f1981b1712e2dc9d479511a949a1/cf/ff8496c789284bc4a77f2111f071f472 2023-10-05 09:00:26,681 INFO [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemState/c223c58452330420ade8b3fde4201990/cf/fcc9a94374bf4d1da2cbe0b5e25ac21d, entries=3, sequenceid=6, filesize=5.4 K 2023-10-05 09:00:26,683 INFO [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for c223c58452330420ade8b3fde4201990 in 89ms, sequenceid=6, compaction requested=false 2023-10-05 09:00:26,683 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-10-05 09:00:26,683 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c223c58452330420ade8b3fde4201990: 2023-10-05 09:00:26,684 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-05 09:00:26,684 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 09:00:26,684 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemState/c223c58452330420ade8b3fde4201990/cf/fcc9a94374bf4d1da2cbe0b5e25ac21d] hfiles 2023-10-05 09:00:26,684 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemState/c223c58452330420ade8b3fde4201990/cf/fcc9a94374bf4d1da2cbe0b5e25ac21d for snapshot=snaptb0-testExportFileSystemState 2023-10-05 09:00:26,686 INFO [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemState/b5d2f1981b1712e2dc9d479511a949a1/cf/ff8496c789284bc4a77f2111f071f472, entries=47, sequenceid=6, filesize=12.8 K 2023-10-05 09:00:26,687 INFO [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for b5d2f1981b1712e2dc9d479511a949a1 in 93ms, sequenceid=6, compaction requested=false 2023-10-05 09:00:26,689 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b5d2f1981b1712e2dc9d479511a949a1: 2023-10-05 09:00:26,689 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-05 09:00:26,689 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 09:00:26,689 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemState/b5d2f1981b1712e2dc9d479511a949a1/cf/ff8496c789284bc4a77f2111f071f472] hfiles 2023-10-05 09:00:26,689 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemState/b5d2f1981b1712e2dc9d479511a949a1/cf/ff8496c789284bc4a77f2111f071f472 for snapshot=snaptb0-testExportFileSystemState 2023-10-05 09:00:26,703 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990. completed. 2023-10-05 09:00:26,703 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990. 2023-10-05 09:00:26,703 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 09:00:26,703 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 09:00:26,703 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,704 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-05 09:00:26,704 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41057,1696496401070' in zk 2023-10-05 09:00:26,709 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,709 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 09:00:26,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,709 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1. completed. 2023-10-05 09:00:26,709 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:00:26,710 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1. 2023-10-05 09:00:26,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:26,711 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 09:00:26,711 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 09:00:26,711 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:26,710 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-05 09:00:26,711 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-05 09:00:26,711 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35953,1696496401154' in zk 2023-10-05 09:00:26,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:26,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:26,713 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,713 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 09:00:26,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 09:00:26,713 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:00:26,713 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-05 09:00:26,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:26,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:26,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 09:00:26,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:26,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41057,1696496401070': 2023-10-05 09:00:26,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41057,1696496401070' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-05 09:00:26,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:26,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:26,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:26,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:26,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 09:00:26,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:26,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:26,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 09:00:26,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:26,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35953,1696496401154': 2023-10-05 09:00:26,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35953,1696496401154' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-05 09:00:26,721 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-10-05 09:00:26,721 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 09:00:26,721 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 09:00:26,721 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-10-05 09:00:26,721 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 09:00:26,724 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,724 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,724 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:26,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:26,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,724 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:26,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,724 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,724 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:26,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,724 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:26,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:26,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:26,725 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:26,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:26,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:26,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 09:00:26,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:26,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:26,725 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:26,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,727 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:26,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 09:00:26,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:26,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:26,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 09:00:26,728 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,729 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,729 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:26,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:26,734 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:26,734 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,734 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:26,734 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:26,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:26,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:26,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:26,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:26,734 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:26,734 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:26,734 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,735 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,735 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,735 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:26,735 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:00:26,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:26,735 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-10-05 09:00:26,734 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:26,736 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-05 09:00:26,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:26,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-05 09:00:26,735 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 09:00:26,735 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:26,736 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:26,737 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:26,737 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,737 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:26,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:26,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:26,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:26,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:26,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:26,738 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310055651123f33924fe4b40fb452a6c030cd, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100590185c9edae34cde8b16c8b5c842884c] mob files 2023-10-05 09:00:26,738 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310055651123f33924fe4b40fb452a6c030cd 2023-10-05 09:00:26,738 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100590185c9edae34cde8b16c8b5c842884c 2023-10-05 09:00:26,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-10-05 09:00:26,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,778 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,779 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-05 09:00:26,779 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,780 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696496426552Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696496426752 (+200 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1696496426752Loading Region manifests for snaptb0-testExportFileSystemState at 1696496426752Writing data manifest for snaptb0-testExportFileSystemState at 1696496426757 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1696496426770 (+13 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696496426779 (+9 ms) 2023-10-05 09:00:26,783 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 09:00:26,785 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 230 msec 2023-10-05 09:00:26,862 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:00:26,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 09:00:26,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 09:00:26,863 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496426863 2023-10-05 09:00:26,864 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45983, tgtDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496426863, rawTgtDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496426863, srcFsUri=hdfs://localhost:45983, srcDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c 2023-10-05 09:00:26,887 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45983, inputRoot=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c 2023-10-05 09:00:26,887 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_956106920_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496426863, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496426863/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,887 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45983, inputRoot=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c, snapshotDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-10-05 09:00:26,899 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496426863/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 09:00:26,929 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:26,930 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:26,931 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:26,931 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:26,932 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:26,932 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:26,933 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:27,013 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/hadoop-1624250692606995849.jar 2023-10-05 09:00:27,014 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:27,015 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:27,015 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:27,016 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:27,016 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:27,017 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:27,018 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 09:00:27,018 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 09:00:27,019 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 09:00:27,020 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 09:00:27,020 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 09:00:27,021 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 09:00:27,021 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 09:00:27,022 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 09:00:27,023 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 09:00:27,023 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 09:00:27,027 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:00:27,028 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:00:27,028 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 09:00:27,029 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:00:27,029 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:00:27,030 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 09:00:27,030 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 09:00:28,276 WARN [Listener at jenkins-hbase4.apache.org/41667] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 09:00:28,279 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-10-05 09:00:28,282 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-05 09:00:29,215 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 09:00:29,216 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 09:00:29,221 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0001_000001 (auth:SIMPLE) 2023-10-05 09:00:29,963 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0002_000001 (auth:SIMPLE) 2023-10-05 09:00:30,773 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 09:00:33,882 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0002_000001 (auth:SIMPLE) 2023-10-05 09:00:36,108 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0002_000001 (auth:SIMPLE) 2023-10-05 09:00:38,818 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0002_000001 (auth:SIMPLE) 2023-10-05 09:00:40,478 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 09:00:40,479 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 09:00:40,511 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-10-05 09:00:40,512 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 09:00:40,512 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 09:00:40,512 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_795266163_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-05 09:00:40,513 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-05 09:00:40,513 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-05 09:00:40,513 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_795266163_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496426863/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496426863/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-05 09:00:40,514 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496426863/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-05 09:00:40,514 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496426863/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-05 09:00:40,521 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-10-05 09:00:40,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-10-05 09:00:40,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-10-05 09:00:40,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-05 09:00:40,528 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496440528"}]},"ts":"1696496440528"} 2023-10-05 09:00:40,530 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-10-05 09:00:40,531 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-10-05 09:00:40,532 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c223c58452330420ade8b3fde4201990, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b5d2f1981b1712e2dc9d479511a949a1, UNASSIGN}] 2023-10-05 09:00:40,534 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b5d2f1981b1712e2dc9d479511a949a1, UNASSIGN 2023-10-05 09:00:40,534 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c223c58452330420ade8b3fde4201990, UNASSIGN 2023-10-05 09:00:40,535 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=b5d2f1981b1712e2dc9d479511a949a1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:40,535 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c223c58452330420ade8b3fde4201990, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:40,535 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696496440535"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496440535"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496440535"}]},"ts":"1696496440535"} 2023-10-05 09:00:40,535 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696496440535"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496440535"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496440535"}]},"ts":"1696496440535"} 2023-10-05 09:00:40,537 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure b5d2f1981b1712e2dc9d479511a949a1, server=jenkins-hbase4.apache.org,35953,1696496401154}] 2023-10-05 09:00:40,538 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure c223c58452330420ade8b3fde4201990, server=jenkins-hbase4.apache.org,41057,1696496401070}] 2023-10-05 09:00:40,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-05 09:00:40,689 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c223c58452330420ade8b3fde4201990 2023-10-05 09:00:40,689 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b5d2f1981b1712e2dc9d479511a949a1 2023-10-05 09:00:40,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c223c58452330420ade8b3fde4201990, disabling compactions & flushes 2023-10-05 09:00:40,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b5d2f1981b1712e2dc9d479511a949a1, disabling compactions & flushes 2023-10-05 09:00:40,690 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990. 2023-10-05 09:00:40,690 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1. 2023-10-05 09:00:40,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990. 2023-10-05 09:00:40,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1. 2023-10-05 09:00:40,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990. after waiting 0 ms 2023-10-05 09:00:40,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1. after waiting 0 ms 2023-10-05 09:00:40,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1. 2023-10-05 09:00:40,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990. 2023-10-05 09:00:40,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemState/b5d2f1981b1712e2dc9d479511a949a1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 09:00:40,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemState/c223c58452330420ade8b3fde4201990/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 09:00:40,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 09:00:40,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 09:00:40,700 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1. 2023-10-05 09:00:40,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b5d2f1981b1712e2dc9d479511a949a1: 2023-10-05 09:00:40,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990. 2023-10-05 09:00:40,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c223c58452330420ade8b3fde4201990: 2023-10-05 09:00:40,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b5d2f1981b1712e2dc9d479511a949a1 2023-10-05 09:00:40,703 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=b5d2f1981b1712e2dc9d479511a949a1, regionState=CLOSED 2023-10-05 09:00:40,703 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696496440703"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496440703"}]},"ts":"1696496440703"} 2023-10-05 09:00:40,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c223c58452330420ade8b3fde4201990 2023-10-05 09:00:40,704 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c223c58452330420ade8b3fde4201990, regionState=CLOSED 2023-10-05 09:00:40,704 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696496440704"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496440704"}]},"ts":"1696496440704"} 2023-10-05 09:00:40,708 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=38 2023-10-05 09:00:40,708 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure b5d2f1981b1712e2dc9d479511a949a1, server=jenkins-hbase4.apache.org,35953,1696496401154 in 168 msec 2023-10-05 09:00:40,709 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=37 2023-10-05 09:00:40,709 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure c223c58452330420ade8b3fde4201990, server=jenkins-hbase4.apache.org,41057,1696496401070 in 169 msec 2023-10-05 09:00:40,710 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b5d2f1981b1712e2dc9d479511a949a1, UNASSIGN in 176 msec 2023-10-05 09:00:40,711 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-10-05 09:00:40,711 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c223c58452330420ade8b3fde4201990, UNASSIGN in 177 msec 2023-10-05 09:00:40,712 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496440712"}]},"ts":"1696496440712"} 2023-10-05 09:00:40,713 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-10-05 09:00:40,715 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-10-05 09:00:40,718 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 194 msec 2023-10-05 09:00:40,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-05 09:00:40,830 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-10-05 09:00:40,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-10-05 09:00:40,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 09:00:40,834 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 09:00:40,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-10-05 09:00:40,835 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 09:00:40,837 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40073] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-10-05 09:00:40,840 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemState/c223c58452330420ade8b3fde4201990 2023-10-05 09:00:40,840 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemState/b5d2f1981b1712e2dc9d479511a949a1 2023-10-05 09:00:40,841 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 09:00:40,841 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 09:00:40,841 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 09:00:40,841 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 09:00:40,841 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-05 09:00:40,841 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-05 09:00:40,841 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-05 09:00:40,841 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-05 09:00:40,842 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 09:00:40,843 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:00:40,843 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 09:00:40,843 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 09:00:40,843 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:00:40,843 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:00:40,843 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 09:00:40,843 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:00:40,843 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemState/c223c58452330420ade8b3fde4201990/cf, FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemState/c223c58452330420ade8b3fde4201990/recovered.edits] 2023-10-05 09:00:40,844 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemState/b5d2f1981b1712e2dc9d479511a949a1/cf, FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemState/b5d2f1981b1712e2dc9d479511a949a1/recovered.edits] 2023-10-05 09:00:40,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-05 09:00:40,848 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemState/c223c58452330420ade8b3fde4201990/cf/fcc9a94374bf4d1da2cbe0b5e25ac21d to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportFileSystemState/c223c58452330420ade8b3fde4201990/cf/fcc9a94374bf4d1da2cbe0b5e25ac21d 2023-10-05 09:00:40,849 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemState/b5d2f1981b1712e2dc9d479511a949a1/cf/ff8496c789284bc4a77f2111f071f472 to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportFileSystemState/b5d2f1981b1712e2dc9d479511a949a1/cf/ff8496c789284bc4a77f2111f071f472 2023-10-05 09:00:40,852 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemState/c223c58452330420ade8b3fde4201990/recovered.edits/9.seqid to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportFileSystemState/c223c58452330420ade8b3fde4201990/recovered.edits/9.seqid 2023-10-05 09:00:40,853 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemState/b5d2f1981b1712e2dc9d479511a949a1/recovered.edits/9.seqid to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportFileSystemState/b5d2f1981b1712e2dc9d479511a949a1/recovered.edits/9.seqid 2023-10-05 09:00:40,853 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemState/c223c58452330420ade8b3fde4201990 2023-10-05 09:00:40,853 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemState/b5d2f1981b1712e2dc9d479511a949a1 2023-10-05 09:00:40,853 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-05 09:00:40,854 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-05 09:00:40,855 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-10-05 09:00:40,858 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310055651123f33924fe4b40fb452a6c030cd to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310055651123f33924fe4b40fb452a6c030cd 2023-10-05 09:00:40,860 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100590185c9edae34cde8b16c8b5c842884c to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100590185c9edae34cde8b16c8b5c842884c 2023-10-05 09:00:40,860 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-05 09:00:40,862 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 09:00:40,865 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-10-05 09:00:40,867 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-10-05 09:00:40,868 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 09:00:40,868 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-10-05 09:00:40,868 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696496440868"}]},"ts":"9223372036854775807"} 2023-10-05 09:00:40,868 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696496440868"}]},"ts":"9223372036854775807"} 2023-10-05 09:00:40,870 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 09:00:40,870 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c223c58452330420ade8b3fde4201990, NAME => 'testtb-testExportFileSystemState,,1696496425508.c223c58452330420ade8b3fde4201990.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b5d2f1981b1712e2dc9d479511a949a1, NAME => 'testtb-testExportFileSystemState,1,1696496425508.b5d2f1981b1712e2dc9d479511a949a1.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 09:00:40,870 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-10-05 09:00:40,870 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696496440870"}]},"ts":"9223372036854775807"} 2023-10-05 09:00:40,872 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-10-05 09:00:40,874 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 09:00:40,875 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 43 msec 2023-10-05 09:00:40,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-05 09:00:40,945 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-10-05 09:00:40,954 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-10-05 09:00:40,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-10-05 09:00:40,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-10-05 09:00:40,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemState 2023-10-05 09:00:40,987 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=765 (was 754) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_795266163_17 at /127.0.0.1:53544 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5555080-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1118843074_1 at /127.0.0.1:53510 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_795266163_17 at /127.0.0.1:42566 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_956106920_17 at /127.0.0.1:34880 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:46201 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1963 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:41667 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x5555080-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1118843074_1 at /127.0.0.1:42540 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5555080-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5555080-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=930 (was 931), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=268 (was 281), ProcessCount=167 (was 167), AvailableMemoryMB=5932 (was 6063) 2023-10-05 09:00:40,988 WARN [Listener at jenkins-hbase4.apache.org/41667] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-05 09:00:41,010 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=930, MaxFileDescriptor=60000, SystemLoadAverage=268, ProcessCount=167, AvailableMemoryMB=5931 2023-10-05 09:00:41,010 WARN [Listener at jenkins-hbase4.apache.org/41667] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-05 09:00:41,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 09:00:41,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-10-05 09:00:41,016 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 09:00:41,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-10-05 09:00:41,017 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 09:00:41,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-05 09:00:41,021 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testConsecutiveExports/f31905a958cc9d082782b5f6a5291a8b 2023-10-05 09:00:41,021 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testConsecutiveExports/22a2eed1057e09b6bc301613e786754b 2023-10-05 09:00:41,021 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testConsecutiveExports/f31905a958cc9d082782b5f6a5291a8b empty. 2023-10-05 09:00:41,022 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testConsecutiveExports/22a2eed1057e09b6bc301613e786754b empty. 2023-10-05 09:00:41,022 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testConsecutiveExports/f31905a958cc9d082782b5f6a5291a8b 2023-10-05 09:00:41,022 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testConsecutiveExports/22a2eed1057e09b6bc301613e786754b 2023-10-05 09:00:41,022 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-05 09:00:41,044 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-10-05 09:00:41,046 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => f31905a958cc9d082782b5f6a5291a8b, NAME => 'testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp 2023-10-05 09:00:41,046 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 22a2eed1057e09b6bc301613e786754b, NAME => 'testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp 2023-10-05 09:00:41,072 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:00:41,073 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 22a2eed1057e09b6bc301613e786754b, disabling compactions & flushes 2023-10-05 09:00:41,073 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b. 2023-10-05 09:00:41,073 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b. 2023-10-05 09:00:41,073 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b. after waiting 0 ms 2023-10-05 09:00:41,073 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b. 2023-10-05 09:00:41,073 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b. 2023-10-05 09:00:41,073 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 22a2eed1057e09b6bc301613e786754b: 2023-10-05 09:00:41,073 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:00:41,073 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing f31905a958cc9d082782b5f6a5291a8b, disabling compactions & flushes 2023-10-05 09:00:41,073 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b. 2023-10-05 09:00:41,073 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b. 2023-10-05 09:00:41,073 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b. after waiting 0 ms 2023-10-05 09:00:41,073 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b. 2023-10-05 09:00:41,073 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b. 2023-10-05 09:00:41,073 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for f31905a958cc9d082782b5f6a5291a8b: 2023-10-05 09:00:41,076 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 09:00:41,077 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696496441077"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496441077"}]},"ts":"1696496441077"} 2023-10-05 09:00:41,078 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696496441077"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496441077"}]},"ts":"1696496441077"} 2023-10-05 09:00:41,080 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 09:00:41,081 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 09:00:41,082 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496441081"}]},"ts":"1696496441081"} 2023-10-05 09:00:41,083 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-10-05 09:00:41,087 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 09:00:41,088 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 09:00:41,088 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 09:00:41,088 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 09:00:41,089 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 09:00:41,089 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f31905a958cc9d082782b5f6a5291a8b, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=22a2eed1057e09b6bc301613e786754b, ASSIGN}] 2023-10-05 09:00:41,092 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=22a2eed1057e09b6bc301613e786754b, ASSIGN 2023-10-05 09:00:41,092 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f31905a958cc9d082782b5f6a5291a8b, ASSIGN 2023-10-05 09:00:41,093 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=22a2eed1057e09b6bc301613e786754b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35953,1696496401154; forceNewPlan=false, retain=false 2023-10-05 09:00:41,093 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f31905a958cc9d082782b5f6a5291a8b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40073,1696496401119; forceNewPlan=false, retain=false 2023-10-05 09:00:41,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-05 09:00:41,244 INFO [jenkins-hbase4:37915] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 09:00:41,247 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=f31905a958cc9d082782b5f6a5291a8b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:41,247 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=22a2eed1057e09b6bc301613e786754b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:41,247 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696496441247"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496441247"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496441247"}]},"ts":"1696496441247"} 2023-10-05 09:00:41,247 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696496441247"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496441247"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496441247"}]},"ts":"1696496441247"} 2023-10-05 09:00:41,249 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure f31905a958cc9d082782b5f6a5291a8b, server=jenkins-hbase4.apache.org,40073,1696496401119}] 2023-10-05 09:00:41,250 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 22a2eed1057e09b6bc301613e786754b, server=jenkins-hbase4.apache.org,35953,1696496401154}] 2023-10-05 09:00:41,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-05 09:00:41,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b. 2023-10-05 09:00:41,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f31905a958cc9d082782b5f6a5291a8b, NAME => 'testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 09:00:41,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b. 2023-10-05 09:00:41,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b. service=AccessControlService 2023-10-05 09:00:41,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 22a2eed1057e09b6bc301613e786754b, NAME => 'testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 09:00:41,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 09:00:41,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b. service=AccessControlService 2023-10-05 09:00:41,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports f31905a958cc9d082782b5f6a5291a8b 2023-10-05 09:00:41,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:00:41,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 09:00:41,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f31905a958cc9d082782b5f6a5291a8b 2023-10-05 09:00:41,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f31905a958cc9d082782b5f6a5291a8b 2023-10-05 09:00:41,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 22a2eed1057e09b6bc301613e786754b 2023-10-05 09:00:41,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:00:41,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 22a2eed1057e09b6bc301613e786754b 2023-10-05 09:00:41,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 22a2eed1057e09b6bc301613e786754b 2023-10-05 09:00:41,409 INFO [StoreOpener-f31905a958cc9d082782b5f6a5291a8b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f31905a958cc9d082782b5f6a5291a8b 2023-10-05 09:00:41,409 INFO [StoreOpener-22a2eed1057e09b6bc301613e786754b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 22a2eed1057e09b6bc301613e786754b 2023-10-05 09:00:41,410 DEBUG [StoreOpener-f31905a958cc9d082782b5f6a5291a8b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testConsecutiveExports/f31905a958cc9d082782b5f6a5291a8b/cf 2023-10-05 09:00:41,410 DEBUG [StoreOpener-f31905a958cc9d082782b5f6a5291a8b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testConsecutiveExports/f31905a958cc9d082782b5f6a5291a8b/cf 2023-10-05 09:00:41,410 DEBUG [StoreOpener-22a2eed1057e09b6bc301613e786754b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testConsecutiveExports/22a2eed1057e09b6bc301613e786754b/cf 2023-10-05 09:00:41,410 DEBUG [StoreOpener-22a2eed1057e09b6bc301613e786754b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testConsecutiveExports/22a2eed1057e09b6bc301613e786754b/cf 2023-10-05 09:00:41,411 INFO [StoreOpener-f31905a958cc9d082782b5f6a5291a8b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f31905a958cc9d082782b5f6a5291a8b columnFamilyName cf 2023-10-05 09:00:41,411 INFO [StoreOpener-22a2eed1057e09b6bc301613e786754b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 22a2eed1057e09b6bc301613e786754b columnFamilyName cf 2023-10-05 09:00:41,412 INFO [StoreOpener-22a2eed1057e09b6bc301613e786754b-1] regionserver.HStore(310): Store=22a2eed1057e09b6bc301613e786754b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 09:00:41,412 INFO [StoreOpener-f31905a958cc9d082782b5f6a5291a8b-1] regionserver.HStore(310): Store=f31905a958cc9d082782b5f6a5291a8b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 09:00:41,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testConsecutiveExports/22a2eed1057e09b6bc301613e786754b 2023-10-05 09:00:41,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testConsecutiveExports/f31905a958cc9d082782b5f6a5291a8b 2023-10-05 09:00:41,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testConsecutiveExports/22a2eed1057e09b6bc301613e786754b 2023-10-05 09:00:41,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testConsecutiveExports/f31905a958cc9d082782b5f6a5291a8b 2023-10-05 09:00:41,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 22a2eed1057e09b6bc301613e786754b 2023-10-05 09:00:41,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f31905a958cc9d082782b5f6a5291a8b 2023-10-05 09:00:41,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testConsecutiveExports/22a2eed1057e09b6bc301613e786754b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 09:00:41,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testConsecutiveExports/f31905a958cc9d082782b5f6a5291a8b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 09:00:41,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 22a2eed1057e09b6bc301613e786754b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60039771, jitterRate=-0.10533769428730011}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 09:00:41,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 22a2eed1057e09b6bc301613e786754b: 2023-10-05 09:00:41,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f31905a958cc9d082782b5f6a5291a8b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65730224, jitterRate=-0.020543336868286133}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 09:00:41,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f31905a958cc9d082782b5f6a5291a8b: 2023-10-05 09:00:41,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b., pid=46, masterSystemTime=1696496441402 2023-10-05 09:00:41,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b., pid=45, masterSystemTime=1696496441401 2023-10-05 09:00:41,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b. 2023-10-05 09:00:41,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b. 2023-10-05 09:00:41,422 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=22a2eed1057e09b6bc301613e786754b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:41,423 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696496441422"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696496441422"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696496441422"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696496441422"}]},"ts":"1696496441422"} 2023-10-05 09:00:41,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b. 2023-10-05 09:00:41,424 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=f31905a958cc9d082782b5f6a5291a8b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:41,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b. 2023-10-05 09:00:41,424 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696496441424"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696496441424"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696496441424"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696496441424"}]},"ts":"1696496441424"} 2023-10-05 09:00:41,427 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-10-05 09:00:41,428 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 22a2eed1057e09b6bc301613e786754b, server=jenkins-hbase4.apache.org,35953,1696496401154 in 175 msec 2023-10-05 09:00:41,428 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-10-05 09:00:41,428 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure f31905a958cc9d082782b5f6a5291a8b, server=jenkins-hbase4.apache.org,40073,1696496401119 in 177 msec 2023-10-05 09:00:41,430 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=22a2eed1057e09b6bc301613e786754b, ASSIGN in 339 msec 2023-10-05 09:00:41,431 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-10-05 09:00:41,431 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f31905a958cc9d082782b5f6a5291a8b, ASSIGN in 339 msec 2023-10-05 09:00:41,432 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 09:00:41,432 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496441432"}]},"ts":"1696496441432"} 2023-10-05 09:00:41,433 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-10-05 09:00:41,435 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 09:00:41,436 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-10-05 09:00:41,437 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40073] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-05 09:00:41,439 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:00:41,439 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:00:41,439 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:00:41,439 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:00:41,442 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-05 09:00:41,442 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-05 09:00:41,442 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-05 09:00:41,446 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-05 09:00:41,447 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 433 msec 2023-10-05 09:00:41,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-05 09:00:41,622 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-10-05 09:00:41,625 DEBUG [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-05 09:00:41,625 DEBUG [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b. 2023-10-05 09:00:41,628 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 09:00:41,636 DEBUG [hconnection-0x197b6539-shared-pool-16] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:00:41,640 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55124, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:00:41,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 09:00:41,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696496441645 (current time:1696496441645). 2023-10-05 09:00:41,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 09:00:41,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(139): Connect 0x6baf2227 to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:00:41,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@738d6564, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:00:41,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:00:41,656 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58186, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:00:41,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6baf2227 to 127.0.0.1:63699 2023-10-05 09:00:41,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:00:41,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(139): Connect 0x6fe0d0bb to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:00:41,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7dcc697a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:00:41,667 DEBUG [hconnection-0x65f285e2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:00:41,670 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58200, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:00:41,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:00:41,676 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55136, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:00:41,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6fe0d0bb to 127.0.0.1:63699 2023-10-05 09:00:41,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:00:41,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-05 09:00:41,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 09:00:41,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 09:00:41,680 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot, current working dir path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 09:00:41,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 09:00:41,683 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 09:00:41,683 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696497041683 2023-10-05 09:00:41,683 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-05 09:00:41,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 09:00:41,685 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 09:00:41,685 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 09:00:41,686 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 09:00:41,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 09:00:41,687 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-10-05 09:00:41,688 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 09:00:41,688 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696497041688 2023-10-05 09:00:41,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,699 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-10-05 09:00:41,699 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:00:41,700 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-10-05 09:00:41,700 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-05 09:00:41,701 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,701 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,702 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:41,702 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:41,702 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:41,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:41,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:41,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:41,702 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:41,703 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:41,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:41,703 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:41,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:41,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:41,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,703 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:41,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,703 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,703 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 09:00:41,704 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,704 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-05 09:00:41,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-05 09:00:41,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-05 09:00:41,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,704 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 09:00:41,704 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 09:00:41,704 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 09:00:41,704 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,704 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 09:00:41,705 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,705 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:00:41,705 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 09:00:41,706 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 09:00:41,706 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:00:41,705 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,707 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 09:00:41,707 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 09:00:41,707 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:00:41,706 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-05 09:00:41,710 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 09:00:41,710 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-05 09:00:41,710 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35953,1696496401154' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-05 09:00:41,707 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-05 09:00:41,710 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40073,1696496401119' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-05 09:00:41,710 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41057,1696496401070' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-05 09:00:41,712 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:41,712 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:41,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:41,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:41,712 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:41,713 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,713 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,713 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,713 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:00:41,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:41,713 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,713 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:00:41,713 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,713 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:00:41,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:41,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:41,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:41,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:41,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:41,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35953,1696496401154' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-05 09:00:41,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d31db7[Count = 1] remaining members to acquire global barrier 2023-10-05 09:00:41,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:41,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:41,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:41,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:41,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:41,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:41,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:41,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:41,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:41,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40073,1696496401119' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-05 09:00:41,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d31db7[Count = 0] remaining members to acquire global barrier 2023-10-05 09:00:41,718 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-05 09:00:41,718 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,725 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,725 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,725 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,725 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 09:00:41,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,725 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:41,725 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 09:00:41,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,725 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-05 09:00:41,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,725 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 09:00:41,726 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:41,726 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 09:00:41,725 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41057,1696496401070' in zk 2023-10-05 09:00:41,726 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b. 2023-10-05 09:00:41,726 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 09:00:41,726 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b. started... 2023-10-05 09:00:41,726 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 09:00:41,726 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 09:00:41,726 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 09:00:41,726 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b. 2023-10-05 09:00:41,726 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f31905a958cc9d082782b5f6a5291a8b: 2023-10-05 09:00:41,726 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b. started... 2023-10-05 09:00:41,727 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,727 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 22a2eed1057e09b6bc301613e786754b: 2023-10-05 09:00:41,727 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 09:00:41,728 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 09:00:41,728 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,728 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 09:00:41,728 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 09:00:41,734 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 09:00:41,734 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:00:41,734 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-05 09:00:41,741 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b. completed. 2023-10-05 09:00:41,741 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b. 2023-10-05 09:00:41,741 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 09:00:41,741 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 09:00:41,741 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:41,747 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-05 09:00:41,747 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40073,1696496401119' in zk 2023-10-05 09:00:41,749 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 09:00:41,749 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:41,749 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:00:41,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:41,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:41,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:41,749 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-05 09:00:41,751 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b. completed. 2023-10-05 09:00:41,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:41,751 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b. 2023-10-05 09:00:41,751 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 09:00:41,751 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 09:00:41,751 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:41,751 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-05 09:00:41,751 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35953,1696496401154' in zk 2023-10-05 09:00:41,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:41,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,752 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:41,753 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 09:00:41,753 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:00:41,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:41,753 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-05 09:00:41,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:41,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:41,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:41,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:41,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:41,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:41,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40073,1696496401119': 2023-10-05 09:00:41,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40073,1696496401119' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-05 09:00:41,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:41,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:41,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:41,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:41,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:41,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:41,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:41,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:41,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:41,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:41,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:41,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:41,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35953,1696496401154': 2023-10-05 09:00:41,760 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35953,1696496401154' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-05 09:00:41,760 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-10-05 09:00:41,760 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 09:00:41,760 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 09:00:41,760 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,760 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 09:00:41,763 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,763 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,763 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,763 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,763 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:41,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,763 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:41,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:41,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:41,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:41,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:41,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:41,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:41,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,767 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:41,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:41,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:41,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:41,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,768 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:41,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:41,768 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:41,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,768 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:41,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:41,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:41,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:41,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:41,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,770 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:41,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:41,771 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:41,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:41,771 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:41,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:41,774 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:41,774 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:41,774 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:41,774 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:41,774 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:41,774 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:41,774 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:41,774 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:41,774 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:41,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:41,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:41,774 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,774 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:41,775 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:41,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:41,775 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,775 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:00:41,775 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:41,775 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:41,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:41,776 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-05 09:00:41,775 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:41,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:41,776 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:41,776 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 09:00:41,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:41,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:41,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:41,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:41,777 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 09:00:41,785 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:00:41,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-05 09:00:41,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-05 09:00:41,786 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 09:00:41,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,790 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,813 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,814 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-05 09:00:41,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,814 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-05 09:00:41,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696496441684Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696496441789 (+105 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1696496441789Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1696496441789Writing data manifest for emptySnaptb0-testConsecutiveExports at 1696496441797 (+8 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1696496441805 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696496441814 (+9 ms) 2023-10-05 09:00:41,816 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 09:00:41,818 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 133 msec 2023-10-05 09:00:41,986 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:00:41,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-05 09:00:41,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 09:00:41,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40073] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 09:00:41,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35953] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 09:00:41,995 DEBUG [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-05 09:00:41,995 DEBUG [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b. 2023-10-05 09:00:41,995 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 09:00:42,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 09:00:42,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696496442006 (current time:1696496442006). 2023-10-05 09:00:42,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 09:00:42,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(139): Connect 0x6692df07 to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:00:42,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@295f0e3f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:00:42,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:00:42,021 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58202, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:00:42,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6692df07 to 127.0.0.1:63699 2023-10-05 09:00:42,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:00:42,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(139): Connect 0x1a3cb55f to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:00:42,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6aa63bf8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:00:42,032 DEBUG [hconnection-0x3b59fe65-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:00:42,035 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58208, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:00:42,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:00:42,039 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55144, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:00:42,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a3cb55f to 127.0.0.1:63699 2023-10-05 09:00:42,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:00:42,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-05 09:00:42,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 09:00:42,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 09:00:42,044 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot, current working dir path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 09:00:42,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 09:00:42,046 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 09:00:42,047 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696497042047 2023-10-05 09:00:42,047 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-05 09:00:42,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 09:00:42,048 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 09:00:42,048 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 09:00:42,052 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 09:00:42,052 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 09:00:42,053 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-10-05 09:00:42,054 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 09:00:42,058 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696497042058 2023-10-05 09:00:42,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-10-05 09:00:42,068 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-10-05 09:00:42,068 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:00:42,069 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-10-05 09:00:42,069 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-05 09:00:42,069 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,069 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,071 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:42,071 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:42,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:42,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:42,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:42,071 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:42,071 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:42,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:42,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:42,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:42,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,072 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:42,072 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:42,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,072 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:42,072 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 09:00:42,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-05 09:00:42,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-05 09:00:42,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-05 09:00:42,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,073 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 09:00:42,073 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 09:00:42,073 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 09:00:42,073 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-05 09:00:42,073 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-05 09:00:42,073 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 09:00:42,073 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:00:42,073 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 09:00:42,073 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:00:42,076 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 09:00:42,076 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 09:00:42,076 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-05 09:00:42,076 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-05 09:00:42,076 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41057,1696496401070' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-05 09:00:42,076 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-05 09:00:42,076 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40073,1696496401119' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-05 09:00:42,076 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 09:00:42,076 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:00:42,077 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 09:00:42,077 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-05 09:00:42,077 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35953,1696496401154' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-05 09:00:42,078 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,080 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:42,080 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,080 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:42,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:42,080 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,080 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:00:42,080 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:42,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:42,080 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,081 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:00:42,081 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,081 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:00:42,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:42,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:42,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 09:00:42,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:42,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:42,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:42,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:42,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40073,1696496401119' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-05 09:00:42,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6bcbef0b[Count = 1] remaining members to acquire global barrier 2023-10-05 09:00:42,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:42,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:42,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:42,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:42,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:42,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 09:00:42,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:42,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:42,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:42,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:42,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35953,1696496401154' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-05 09:00:42,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6bcbef0b[Count = 0] remaining members to acquire global barrier 2023-10-05 09:00:42,086 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-05 09:00:42,086 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,087 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,087 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,087 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,087 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 09:00:42,087 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 09:00:42,087 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,087 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 09:00:42,088 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 09:00:42,087 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-05 09:00:42,088 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b. 2023-10-05 09:00:42,088 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 09:00:42,088 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b. started... 2023-10-05 09:00:42,088 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:42,088 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 09:00:42,088 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41057,1696496401070' in zk 2023-10-05 09:00:42,088 INFO [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f31905a958cc9d082782b5f6a5291a8b 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-05 09:00:42,090 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 09:00:42,090 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:00:42,090 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-05 09:00:42,094 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 09:00:42,094 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 09:00:42,094 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b. 2023-10-05 09:00:42,094 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b. started... 2023-10-05 09:00:42,094 INFO [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 22a2eed1057e09b6bc301613e786754b 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-05 09:00:42,136 INFO [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231005b45e4accebe34be094d326bfb5379881 to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231005b45e4accebe34be094d326bfb5379881 2023-10-05 09:00:42,138 INFO [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231005b763b3ef1a034889b355f92c7a4a91d2 to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231005b763b3ef1a034889b355f92c7a4a91d2 2023-10-05 09:00:42,144 INFO [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testConsecutiveExports/f31905a958cc9d082782b5f6a5291a8b/.tmp/cf/45f604c9a6c54279a1cb220dac31be01 2023-10-05 09:00:42,146 INFO [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testConsecutiveExports/22a2eed1057e09b6bc301613e786754b/.tmp/cf/45070f9459214a07a3e430cbdc01cd03 2023-10-05 09:00:42,149 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:00:42,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-05 09:00:42,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-05 09:00:42,150 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 09:00:42,151 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testConsecutiveExports/f31905a958cc9d082782b5f6a5291a8b/.tmp/cf/45f604c9a6c54279a1cb220dac31be01 as hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testConsecutiveExports/f31905a958cc9d082782b5f6a5291a8b/cf/45f604c9a6c54279a1cb220dac31be01 2023-10-05 09:00:42,153 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testConsecutiveExports/22a2eed1057e09b6bc301613e786754b/.tmp/cf/45070f9459214a07a3e430cbdc01cd03 as hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testConsecutiveExports/22a2eed1057e09b6bc301613e786754b/cf/45070f9459214a07a3e430cbdc01cd03 2023-10-05 09:00:42,158 INFO [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testConsecutiveExports/f31905a958cc9d082782b5f6a5291a8b/cf/45f604c9a6c54279a1cb220dac31be01, entries=3, sequenceid=6, filesize=5.4 K 2023-10-05 09:00:42,159 INFO [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for f31905a958cc9d082782b5f6a5291a8b in 71ms, sequenceid=6, compaction requested=false 2023-10-05 09:00:42,160 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-05 09:00:42,160 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f31905a958cc9d082782b5f6a5291a8b: 2023-10-05 09:00:42,160 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-05 09:00:42,161 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 09:00:42,161 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testConsecutiveExports/f31905a958cc9d082782b5f6a5291a8b/cf/45f604c9a6c54279a1cb220dac31be01] hfiles 2023-10-05 09:00:42,161 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testConsecutiveExports/f31905a958cc9d082782b5f6a5291a8b/cf/45f604c9a6c54279a1cb220dac31be01 for snapshot=snaptb0-testConsecutiveExports 2023-10-05 09:00:42,162 INFO [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testConsecutiveExports/22a2eed1057e09b6bc301613e786754b/cf/45070f9459214a07a3e430cbdc01cd03, entries=47, sequenceid=6, filesize=12.7 K 2023-10-05 09:00:42,163 INFO [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 22a2eed1057e09b6bc301613e786754b in 69ms, sequenceid=6, compaction requested=false 2023-10-05 09:00:42,165 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 22a2eed1057e09b6bc301613e786754b: 2023-10-05 09:00:42,165 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-05 09:00:42,165 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 09:00:42,165 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testConsecutiveExports/22a2eed1057e09b6bc301613e786754b/cf/45070f9459214a07a3e430cbdc01cd03] hfiles 2023-10-05 09:00:42,165 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testConsecutiveExports/22a2eed1057e09b6bc301613e786754b/cf/45070f9459214a07a3e430cbdc01cd03 for snapshot=snaptb0-testConsecutiveExports 2023-10-05 09:00:42,186 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b. completed. 2023-10-05 09:00:42,187 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b. 2023-10-05 09:00:42,187 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 09:00:42,187 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 09:00:42,187 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:42,187 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-05 09:00:42,187 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40073,1696496401119' in zk 2023-10-05 09:00:42,189 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:42,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:42,189 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 09:00:42,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:42,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:42,190 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:00:42,190 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-05 09:00:42,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:42,192 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b. completed. 2023-10-05 09:00:42,192 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b. 2023-10-05 09:00:42,192 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 09:00:42,193 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 09:00:42,193 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:42,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:42,193 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-05 09:00:42,193 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35953,1696496401154' in zk 2023-10-05 09:00:42,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 09:00:42,195 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:42,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:42,195 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 09:00:42,196 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:00:42,196 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-05 09:00:42,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:42,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:42,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:42,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 09:00:42,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:42,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:42,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:42,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40073,1696496401119': 2023-10-05 09:00:42,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40073,1696496401119' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-05 09:00:42,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:42,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:42,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:42,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:42,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:42,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 09:00:42,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:42,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:42,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:42,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:42,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 09:00:42,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:42,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:42,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:42,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35953,1696496401154': 2023-10-05 09:00:42,204 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35953,1696496401154' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-05 09:00:42,204 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-10-05 09:00:42,204 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 09:00:42,204 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 09:00:42,204 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-10-05 09:00:42,204 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 09:00:42,206 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,206 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:00:42,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:00:42,206 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,206 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,207 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:42,206 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:42,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:00:42,207 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:42,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,207 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:42,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 09:00:42,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:42,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:42,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:42,207 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:42,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:42,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:42,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:42,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:00:42,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,208 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:42,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 09:00:42,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:42,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:42,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:42,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:00:42,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 09:00:42,210 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:42,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:42,210 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:42,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:42,211 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:42,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:42,217 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:42,218 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:42,218 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:42,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:42,218 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:42,218 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:42,218 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,218 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:42,218 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:42,218 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,218 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:00:42,218 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,218 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:00:42,218 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:00:42,218 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:00:42,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:42,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:42,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:42,218 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:00:42,220 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:00:42,218 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-10-05 09:00:42,218 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,220 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-05 09:00:42,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:00:42,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:00:42,220 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,220 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-05 09:00:42,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:42,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:42,221 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 09:00:42,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:42,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:42,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:00:42,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:00:42,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231005b763b3ef1a034889b355f92c7a4a91d2, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231005b45e4accebe34be094d326bfb5379881] mob files 2023-10-05 09:00:42,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231005b763b3ef1a034889b355f92c7a4a91d2 2023-10-05 09:00:42,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231005b45e4accebe34be094d326bfb5379881 2023-10-05 09:00:42,234 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-10-05 09:00:42,234 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,255 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,256 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-05 09:00:42,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,257 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,257 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696496442047Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696496442234 (+187 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1696496442234Loading Region manifests for snaptb0-testConsecutiveExports at 1696496442234Writing data manifest for snaptb0-testConsecutiveExports at 1696496442238 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1696496442249 (+11 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696496442256 (+7 ms) 2023-10-05 09:00:42,259 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 09:00:42,261 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 211 msec 2023-10-05 09:00:42,351 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:00:42,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-05 09:00:42,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 09:00:42,352 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/local-export-1696496442352 2023-10-05 09:00:42,352 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/local-export-1696496442352, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/local-export-1696496442352, srcFsUri=hdfs://localhost:45983, srcDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c 2023-10-05 09:00:42,373 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45983, inputRoot=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c 2023-10-05 09:00:42,374 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@373cda12, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/local-export-1696496442352, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/local-export-1696496442352/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,374 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45983, inputRoot=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c, snapshotDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-05 09:00:42,382 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/local-export-1696496442352/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 09:00:42,395 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:42,395 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:42,395 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:42,396 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:42,396 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:42,396 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:42,396 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:42,464 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/hadoop-6107739995607809940.jar 2023-10-05 09:00:42,465 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:42,465 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:42,466 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:42,466 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:42,466 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:42,466 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:42,467 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 09:00:42,467 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 09:00:42,468 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 09:00:42,468 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 09:00:42,468 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 09:00:42,469 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 09:00:42,469 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 09:00:42,469 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 09:00:42,470 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 09:00:42,470 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 09:00:42,471 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:00:42,471 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:00:42,471 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 09:00:42,472 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:00:42,472 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:00:42,472 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 09:00:42,473 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 09:00:42,880 WARN [Listener at jenkins-hbase4.apache.org/41667] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 09:00:42,883 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-05 09:00:42,885 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-05 09:00:45,000 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 09:00:45,000 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 09:00:45,003 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0002_000001 (auth:SIMPLE) 2023-10-05 09:00:45,233 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0003_000001 (auth:SIMPLE) 2023-10-05 09:00:46,291 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 09:00:49,015 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0003_000001 (auth:SIMPLE) 2023-10-05 09:00:51,242 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0003_000001 (auth:SIMPLE) 2023-10-05 09:00:53,836 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0003_000001 (auth:SIMPLE) 2023-10-05 09:00:55,056 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 09:00:55,056 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 09:00:55,061 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-05 09:00:55,061 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 09:00:55,062 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 09:00:55,062 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_795266163_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 09:00:55,065 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-05 09:00:55,065 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-05 09:00:55,065 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@7d1d1920 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/local-export-1696496442352/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/local-export-1696496442352/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 09:00:55,065 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/local-export-1696496442352/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-05 09:00:55,065 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/local-export-1696496442352/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-05 09:00:55,067 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/local-export-1696496442352, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/local-export-1696496442352, srcFsUri=hdfs://localhost:45983, srcDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c 2023-10-05 09:00:55,089 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45983, inputRoot=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c 2023-10-05 09:00:55,089 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@27adaee4, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/local-export-1696496442352, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/local-export-1696496442352/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 09:00:55,089 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45983, inputRoot=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c, snapshotDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-05 09:00:55,101 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/local-export-1696496442352/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 09:00:55,113 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:55,114 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:55,114 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:55,115 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:55,115 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:55,116 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:55,116 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:55,188 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/hadoop-2080456468697176281.jar 2023-10-05 09:00:55,189 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:55,189 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:55,190 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:55,190 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:55,190 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:55,191 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 09:00:55,191 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 09:00:55,192 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 09:00:55,192 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 09:00:55,192 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 09:00:55,193 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 09:00:55,193 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 09:00:55,193 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 09:00:55,194 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 09:00:55,194 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 09:00:55,195 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 09:00:55,195 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:00:55,196 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:00:55,196 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 09:00:55,197 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:00:55,197 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:00:55,198 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 09:00:55,198 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 09:00:55,591 WARN [Listener at jenkins-hbase4.apache.org/41667] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 09:00:55,593 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-05 09:00:55,596 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-05 09:01:00,018 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 09:01:00,019 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 09:01:00,022 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0003_000001 (auth:SIMPLE) 2023-10-05 09:01:01,014 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0004_000001 (auth:SIMPLE) 2023-10-05 09:01:04,601 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0004_000001 (auth:SIMPLE) 2023-10-05 09:01:06,814 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0004_000001 (auth:SIMPLE) 2023-10-05 09:01:08,975 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0004_000001 (auth:SIMPLE) 2023-10-05 09:01:10,816 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 09:01:10,816 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 09:01:10,819 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-05 09:01:10,819 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 09:01:10,820 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 09:01:10,820 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_795266163_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 09:01:10,822 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-05 09:01:10,822 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-05 09:01:10,822 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@7d1d1920 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/local-export-1696496442352/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/local-export-1696496442352/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 09:01:10,823 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/local-export-1696496442352/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-05 09:01:10,823 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/local-export-1696496442352/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-05 09:01:10,835 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-10-05 09:01:10,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-10-05 09:01:10,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-10-05 09:01:10,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-05 09:01:10,840 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496470839"}]},"ts":"1696496470839"} 2023-10-05 09:01:10,841 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-10-05 09:01:10,842 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-10-05 09:01:10,843 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f31905a958cc9d082782b5f6a5291a8b, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=22a2eed1057e09b6bc301613e786754b, UNASSIGN}] 2023-10-05 09:01:10,845 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f31905a958cc9d082782b5f6a5291a8b, UNASSIGN 2023-10-05 09:01:10,845 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=22a2eed1057e09b6bc301613e786754b, UNASSIGN 2023-10-05 09:01:10,846 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=f31905a958cc9d082782b5f6a5291a8b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:10,846 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=22a2eed1057e09b6bc301613e786754b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:10,847 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696496470846"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496470846"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496470846"}]},"ts":"1696496470846"} 2023-10-05 09:01:10,847 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696496470846"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496470846"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496470846"}]},"ts":"1696496470846"} 2023-10-05 09:01:10,853 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure f31905a958cc9d082782b5f6a5291a8b, server=jenkins-hbase4.apache.org,40073,1696496401119}] 2023-10-05 09:01:10,854 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 22a2eed1057e09b6bc301613e786754b, server=jenkins-hbase4.apache.org,35953,1696496401154}] 2023-10-05 09:01:10,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-05 09:01:11,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f31905a958cc9d082782b5f6a5291a8b 2023-10-05 09:01:11,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f31905a958cc9d082782b5f6a5291a8b, disabling compactions & flushes 2023-10-05 09:01:11,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b. 2023-10-05 09:01:11,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b. 2023-10-05 09:01:11,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b. after waiting 0 ms 2023-10-05 09:01:11,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b. 2023-10-05 09:01:11,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 22a2eed1057e09b6bc301613e786754b 2023-10-05 09:01:11,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 22a2eed1057e09b6bc301613e786754b, disabling compactions & flushes 2023-10-05 09:01:11,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b. 2023-10-05 09:01:11,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b. 2023-10-05 09:01:11,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b. after waiting 0 ms 2023-10-05 09:01:11,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b. 2023-10-05 09:01:11,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testConsecutiveExports/f31905a958cc9d082782b5f6a5291a8b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 09:01:11,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testConsecutiveExports/22a2eed1057e09b6bc301613e786754b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 09:01:11,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 09:01:11,020 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b. 2023-10-05 09:01:11,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f31905a958cc9d082782b5f6a5291a8b: 2023-10-05 09:01:11,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 09:01:11,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b. 2023-10-05 09:01:11,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 22a2eed1057e09b6bc301613e786754b: 2023-10-05 09:01:11,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f31905a958cc9d082782b5f6a5291a8b 2023-10-05 09:01:11,023 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=f31905a958cc9d082782b5f6a5291a8b, regionState=CLOSED 2023-10-05 09:01:11,023 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696496471023"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496471023"}]},"ts":"1696496471023"} 2023-10-05 09:01:11,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 22a2eed1057e09b6bc301613e786754b 2023-10-05 09:01:11,023 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=22a2eed1057e09b6bc301613e786754b, regionState=CLOSED 2023-10-05 09:01:11,024 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696496471023"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496471023"}]},"ts":"1696496471023"} 2023-10-05 09:01:11,026 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-10-05 09:01:11,027 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure f31905a958cc9d082782b5f6a5291a8b, server=jenkins-hbase4.apache.org,40073,1696496401119 in 172 msec 2023-10-05 09:01:11,027 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-10-05 09:01:11,027 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 22a2eed1057e09b6bc301613e786754b, server=jenkins-hbase4.apache.org,35953,1696496401154 in 171 msec 2023-10-05 09:01:11,028 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f31905a958cc9d082782b5f6a5291a8b, UNASSIGN in 184 msec 2023-10-05 09:01:11,029 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-10-05 09:01:11,029 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=22a2eed1057e09b6bc301613e786754b, UNASSIGN in 184 msec 2023-10-05 09:01:11,030 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496471030"}]},"ts":"1696496471030"} 2023-10-05 09:01:11,031 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-10-05 09:01:11,032 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-10-05 09:01:11,034 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 198 msec 2023-10-05 09:01:11,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-05 09:01:11,141 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-10-05 09:01:11,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-10-05 09:01:11,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 09:01:11,145 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 09:01:11,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-10-05 09:01:11,146 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 09:01:11,149 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40073] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-10-05 09:01:11,152 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 09:01:11,152 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 09:01:11,152 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 09:01:11,152 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 09:01:11,153 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-05 09:01:11,153 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-05 09:01:11,153 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-05 09:01:11,153 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testConsecutiveExports/f31905a958cc9d082782b5f6a5291a8b 2023-10-05 09:01:11,154 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testConsecutiveExports/22a2eed1057e09b6bc301613e786754b 2023-10-05 09:01:11,154 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 09:01:11,154 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:11,154 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:11,154 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 09:01:11,154 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:11,154 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 09:01:11,154 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-10-05 09:01:11,155 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 09:01:11,155 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:11,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-05 09:01:11,157 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testConsecutiveExports/f31905a958cc9d082782b5f6a5291a8b/cf, FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testConsecutiveExports/f31905a958cc9d082782b5f6a5291a8b/recovered.edits] 2023-10-05 09:01:11,157 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testConsecutiveExports/22a2eed1057e09b6bc301613e786754b/cf, FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testConsecutiveExports/22a2eed1057e09b6bc301613e786754b/recovered.edits] 2023-10-05 09:01:11,162 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testConsecutiveExports/f31905a958cc9d082782b5f6a5291a8b/cf/45f604c9a6c54279a1cb220dac31be01 to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testConsecutiveExports/f31905a958cc9d082782b5f6a5291a8b/cf/45f604c9a6c54279a1cb220dac31be01 2023-10-05 09:01:11,162 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testConsecutiveExports/22a2eed1057e09b6bc301613e786754b/cf/45070f9459214a07a3e430cbdc01cd03 to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testConsecutiveExports/22a2eed1057e09b6bc301613e786754b/cf/45070f9459214a07a3e430cbdc01cd03 2023-10-05 09:01:11,165 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testConsecutiveExports/f31905a958cc9d082782b5f6a5291a8b/recovered.edits/9.seqid to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testConsecutiveExports/f31905a958cc9d082782b5f6a5291a8b/recovered.edits/9.seqid 2023-10-05 09:01:11,165 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testConsecutiveExports/22a2eed1057e09b6bc301613e786754b/recovered.edits/9.seqid to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testConsecutiveExports/22a2eed1057e09b6bc301613e786754b/recovered.edits/9.seqid 2023-10-05 09:01:11,165 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testConsecutiveExports/f31905a958cc9d082782b5f6a5291a8b 2023-10-05 09:01:11,165 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testConsecutiveExports/22a2eed1057e09b6bc301613e786754b 2023-10-05 09:01:11,166 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-05 09:01:11,166 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-05 09:01:11,167 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-10-05 09:01:11,170 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231005b763b3ef1a034889b355f92c7a4a91d2 to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231005b763b3ef1a034889b355f92c7a4a91d2 2023-10-05 09:01:11,171 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231005b45e4accebe34be094d326bfb5379881 to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231005b45e4accebe34be094d326bfb5379881 2023-10-05 09:01:11,171 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-05 09:01:11,173 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 09:01:11,176 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-10-05 09:01:11,177 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-10-05 09:01:11,178 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 09:01:11,178 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-10-05 09:01:11,178 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696496471178"}]},"ts":"9223372036854775807"} 2023-10-05 09:01:11,179 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696496471178"}]},"ts":"9223372036854775807"} 2023-10-05 09:01:11,180 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 09:01:11,180 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f31905a958cc9d082782b5f6a5291a8b, NAME => 'testtb-testConsecutiveExports,,1696496441012.f31905a958cc9d082782b5f6a5291a8b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 22a2eed1057e09b6bc301613e786754b, NAME => 'testtb-testConsecutiveExports,1,1696496441012.22a2eed1057e09b6bc301613e786754b.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 09:01:11,180 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-10-05 09:01:11,180 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696496471180"}]},"ts":"9223372036854775807"} 2023-10-05 09:01:11,182 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-10-05 09:01:11,184 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 09:01:11,185 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 42 msec 2023-10-05 09:01:11,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-05 09:01:11,257 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-10-05 09:01:11,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-10-05 09:01:11,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-10-05 09:01:11,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-10-05 09:01:11,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testConsecutiveExports 2023-10-05 09:01:11,294 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=751 (was 765), OpenFileDescriptor=907 (was 930), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=210 (was 268), ProcessCount=167 (was 167), AvailableMemoryMB=5797 (was 5931) 2023-10-05 09:01:11,295 WARN [Listener at jenkins-hbase4.apache.org/41667] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-10-05 09:01:11,312 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=751, OpenFileDescriptor=907, MaxFileDescriptor=60000, SystemLoadAverage=210, ProcessCount=167, AvailableMemoryMB=5796 2023-10-05 09:01:11,312 WARN [Listener at jenkins-hbase4.apache.org/41667] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-10-05 09:01:11,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 09:01:11,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:11,316 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 09:01:11,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-10-05 09:01:11,317 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 09:01:11,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-05 09:01:11,319 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/44fd85ee9bbf7d274f8281f2de8ce2da 2023-10-05 09:01:11,319 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a54404ee4996be145e1e54cc01479570 2023-10-05 09:01:11,320 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/44fd85ee9bbf7d274f8281f2de8ce2da empty. 2023-10-05 09:01:11,320 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a54404ee4996be145e1e54cc01479570 empty. 2023-10-05 09:01:11,320 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/44fd85ee9bbf7d274f8281f2de8ce2da 2023-10-05 09:01:11,320 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a54404ee4996be145e1e54cc01479570 2023-10-05 09:01:11,321 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-05 09:01:11,331 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-10-05 09:01:11,332 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => a54404ee4996be145e1e54cc01479570, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp 2023-10-05 09:01:11,332 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 44fd85ee9bbf7d274f8281f2de8ce2da, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp 2023-10-05 09:01:11,345 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:01:11,345 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing a54404ee4996be145e1e54cc01479570, disabling compactions & flushes 2023-10-05 09:01:11,345 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570. 2023-10-05 09:01:11,345 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570. 2023-10-05 09:01:11,345 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570. after waiting 0 ms 2023-10-05 09:01:11,345 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570. 2023-10-05 09:01:11,345 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570. 2023-10-05 09:01:11,345 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for a54404ee4996be145e1e54cc01479570: 2023-10-05 09:01:11,345 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:01:11,345 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 44fd85ee9bbf7d274f8281f2de8ce2da, disabling compactions & flushes 2023-10-05 09:01:11,346 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da. 2023-10-05 09:01:11,346 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da. 2023-10-05 09:01:11,346 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da. after waiting 0 ms 2023-10-05 09:01:11,346 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da. 2023-10-05 09:01:11,346 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da. 2023-10-05 09:01:11,346 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 44fd85ee9bbf7d274f8281f2de8ce2da: 2023-10-05 09:01:11,348 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 09:01:11,349 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696496471349"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496471349"}]},"ts":"1696496471349"} 2023-10-05 09:01:11,350 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696496471349"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496471349"}]},"ts":"1696496471349"} 2023-10-05 09:01:11,361 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 09:01:11,362 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 09:01:11,362 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496471362"}]},"ts":"1696496471362"} 2023-10-05 09:01:11,363 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-10-05 09:01:11,367 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 09:01:11,368 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 09:01:11,368 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 09:01:11,368 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 09:01:11,368 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 09:01:11,368 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=44fd85ee9bbf7d274f8281f2de8ce2da, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a54404ee4996be145e1e54cc01479570, ASSIGN}] 2023-10-05 09:01:11,370 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=44fd85ee9bbf7d274f8281f2de8ce2da, ASSIGN 2023-10-05 09:01:11,370 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a54404ee4996be145e1e54cc01479570, ASSIGN 2023-10-05 09:01:11,371 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=44fd85ee9bbf7d274f8281f2de8ce2da, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35953,1696496401154; forceNewPlan=false, retain=false 2023-10-05 09:01:11,371 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a54404ee4996be145e1e54cc01479570, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41057,1696496401070; forceNewPlan=false, retain=false 2023-10-05 09:01:11,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-05 09:01:11,521 INFO [jenkins-hbase4:37915] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 09:01:11,524 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=a54404ee4996be145e1e54cc01479570, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:11,524 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=44fd85ee9bbf7d274f8281f2de8ce2da, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:11,524 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696496471524"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496471524"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496471524"}]},"ts":"1696496471524"} 2023-10-05 09:01:11,524 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696496471524"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496471524"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496471524"}]},"ts":"1696496471524"} 2023-10-05 09:01:11,526 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure a54404ee4996be145e1e54cc01479570, server=jenkins-hbase4.apache.org,41057,1696496401070}] 2023-10-05 09:01:11,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 44fd85ee9bbf7d274f8281f2de8ce2da, server=jenkins-hbase4.apache.org,35953,1696496401154}] 2023-10-05 09:01:11,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-05 09:01:11,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570. 2023-10-05 09:01:11,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a54404ee4996be145e1e54cc01479570, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 09:01:11,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da. 2023-10-05 09:01:11,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 44fd85ee9bbf7d274f8281f2de8ce2da, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 09:01:11,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570. service=AccessControlService 2023-10-05 09:01:11,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da. service=AccessControlService 2023-10-05 09:01:11,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 09:01:11,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 09:01:11,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion a54404ee4996be145e1e54cc01479570 2023-10-05 09:01:11,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 44fd85ee9bbf7d274f8281f2de8ce2da 2023-10-05 09:01:11,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:01:11,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:01:11,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a54404ee4996be145e1e54cc01479570 2023-10-05 09:01:11,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a54404ee4996be145e1e54cc01479570 2023-10-05 09:01:11,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 44fd85ee9bbf7d274f8281f2de8ce2da 2023-10-05 09:01:11,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 44fd85ee9bbf7d274f8281f2de8ce2da 2023-10-05 09:01:11,690 INFO [StoreOpener-a54404ee4996be145e1e54cc01479570-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a54404ee4996be145e1e54cc01479570 2023-10-05 09:01:11,690 INFO [StoreOpener-44fd85ee9bbf7d274f8281f2de8ce2da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 44fd85ee9bbf7d274f8281f2de8ce2da 2023-10-05 09:01:11,691 DEBUG [StoreOpener-a54404ee4996be145e1e54cc01479570-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a54404ee4996be145e1e54cc01479570/cf 2023-10-05 09:01:11,691 DEBUG [StoreOpener-a54404ee4996be145e1e54cc01479570-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a54404ee4996be145e1e54cc01479570/cf 2023-10-05 09:01:11,691 DEBUG [StoreOpener-44fd85ee9bbf7d274f8281f2de8ce2da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion/44fd85ee9bbf7d274f8281f2de8ce2da/cf 2023-10-05 09:01:11,691 DEBUG [StoreOpener-44fd85ee9bbf7d274f8281f2de8ce2da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion/44fd85ee9bbf7d274f8281f2de8ce2da/cf 2023-10-05 09:01:11,692 INFO [StoreOpener-44fd85ee9bbf7d274f8281f2de8ce2da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 44fd85ee9bbf7d274f8281f2de8ce2da columnFamilyName cf 2023-10-05 09:01:11,692 INFO [StoreOpener-a54404ee4996be145e1e54cc01479570-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a54404ee4996be145e1e54cc01479570 columnFamilyName cf 2023-10-05 09:01:11,694 INFO [StoreOpener-44fd85ee9bbf7d274f8281f2de8ce2da-1] regionserver.HStore(310): Store=44fd85ee9bbf7d274f8281f2de8ce2da/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 09:01:11,694 INFO [StoreOpener-a54404ee4996be145e1e54cc01479570-1] regionserver.HStore(310): Store=a54404ee4996be145e1e54cc01479570/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 09:01:11,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion/44fd85ee9bbf7d274f8281f2de8ce2da 2023-10-05 09:01:11,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a54404ee4996be145e1e54cc01479570 2023-10-05 09:01:11,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion/44fd85ee9bbf7d274f8281f2de8ce2da 2023-10-05 09:01:11,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a54404ee4996be145e1e54cc01479570 2023-10-05 09:01:11,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 44fd85ee9bbf7d274f8281f2de8ce2da 2023-10-05 09:01:11,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a54404ee4996be145e1e54cc01479570 2023-10-05 09:01:11,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion/44fd85ee9bbf7d274f8281f2de8ce2da/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 09:01:11,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a54404ee4996be145e1e54cc01479570/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 09:01:11,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 44fd85ee9bbf7d274f8281f2de8ce2da; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63171942, jitterRate=-0.0586647093296051}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 09:01:11,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 44fd85ee9bbf7d274f8281f2de8ce2da: 2023-10-05 09:01:11,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a54404ee4996be145e1e54cc01479570; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59940049, jitterRate=-0.10682366788387299}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 09:01:11,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a54404ee4996be145e1e54cc01479570: 2023-10-05 09:01:11,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da., pid=61, masterSystemTime=1696496471680 2023-10-05 09:01:11,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570., pid=60, masterSystemTime=1696496471677 2023-10-05 09:01:11,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da. 2023-10-05 09:01:11,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da. 2023-10-05 09:01:11,704 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=44fd85ee9bbf7d274f8281f2de8ce2da, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:11,704 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696496471704"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696496471704"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696496471704"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696496471704"}]},"ts":"1696496471704"} 2023-10-05 09:01:11,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570. 2023-10-05 09:01:11,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570. 2023-10-05 09:01:11,705 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=a54404ee4996be145e1e54cc01479570, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:11,705 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696496471705"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696496471705"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696496471705"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696496471705"}]},"ts":"1696496471705"} 2023-10-05 09:01:11,708 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-10-05 09:01:11,708 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 44fd85ee9bbf7d274f8281f2de8ce2da, server=jenkins-hbase4.apache.org,35953,1696496401154 in 180 msec 2023-10-05 09:01:11,710 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-10-05 09:01:11,710 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure a54404ee4996be145e1e54cc01479570, server=jenkins-hbase4.apache.org,41057,1696496401070 in 181 msec 2023-10-05 09:01:11,711 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=44fd85ee9bbf7d274f8281f2de8ce2da, ASSIGN in 340 msec 2023-10-05 09:01:11,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-10-05 09:01:11,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a54404ee4996be145e1e54cc01479570, ASSIGN in 342 msec 2023-10-05 09:01:11,712 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 09:01:11,712 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496471712"}]},"ts":"1696496471712"} 2023-10-05 09:01:11,714 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-10-05 09:01:11,716 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 09:01:11,716 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-10-05 09:01:11,717 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40073] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-05 09:01:11,719 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:11,719 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:11,719 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:11,719 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:11,721 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 09:01:11,721 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 09:01:11,721 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 09:01:11,721 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 09:01:11,722 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 407 msec 2023-10-05 09:01:11,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-05 09:01:11,921 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-10-05 09:01:11,923 DEBUG [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:11,923 DEBUG [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da. 2023-10-05 09:01:11,925 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 09:01:11,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 09:01:11,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696496471937 (current time:1696496471937). 2023-10-05 09:01:11,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 09:01:11,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(139): Connect 0x1a980262 to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:01:11,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15dc3cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:01:11,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:01:11,947 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:01:11,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a980262 to 127.0.0.1:63699 2023-10-05 09:01:11,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:01:11,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(139): Connect 0x3d62c737 to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:01:11,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@673359eb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:01:11,956 DEBUG [hconnection-0x89fa562-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:01:11,957 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50230, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:01:11,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:01:11,963 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41782, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:01:11,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d62c737 to 127.0.0.1:63699 2023-10-05 09:01:11,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:01:11,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-05 09:01:11,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 09:01:11,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 09:01:11,967 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot, current working dir path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 09:01:11,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 09:01:11,969 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 09:01:11,970 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696497071970 2023-10-05 09:01:11,970 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:11,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 09:01:11,971 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 09:01:11,971 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 09:01:11,972 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 09:01:11,972 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 09:01:11,973 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-10-05 09:01:11,974 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 09:01:11,974 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696497071974 2023-10-05 09:01:11,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:11,985 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-05 09:01:11,985 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:11,986 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-05 09:01:11,986 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-05 09:01:11,986 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:11,986 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:11,987 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:11,988 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:11,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:11,988 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:11,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:11,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:11,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:11,987 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:11,988 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:11,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:11,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:11,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:11,988 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:11,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:11,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:11,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:11,988 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:11,989 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 09:01:11,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:11,989 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:11,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-05 09:01:11,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:11,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-05 09:01:11,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:11,989 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 09:01:11,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-05 09:01:11,989 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 09:01:11,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:11,989 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:11,989 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 09:01:11,989 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 09:01:11,989 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:11,989 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:11,990 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 09:01:11,990 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:11,990 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 09:01:11,991 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 09:01:11,991 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:11,991 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 09:01:11,991 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 09:01:11,991 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 09:01:11,991 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40073,1696496401119' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 09:01:11,990 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:11,991 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41057,1696496401070' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 09:01:11,992 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 09:01:11,992 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 09:01:11,992 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35953,1696496401154' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 09:01:11,994 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:11,994 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:11,994 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:11,994 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:01:11,994 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:11,994 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:11,995 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:11,995 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:11,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:11,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:11,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:11,995 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:01:11,995 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:11,995 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:01:11,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:11,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:11,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:11,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:11,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:11,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:11,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:11,996 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41057,1696496401070' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-05 09:01:11,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@652a21da[Count = 1] remaining members to acquire global barrier 2023-10-05 09:01:11,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:11,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:11,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:11,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:11,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:11,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:11,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:11,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:11,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:11,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:11,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35953,1696496401154' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-05 09:01:11,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@652a21da[Count = 0] remaining members to acquire global barrier 2023-10-05 09:01:11,998 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-05 09:01:11,998 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,001 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,001 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,001 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,001 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 09:01:12,001 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,001 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 09:01:12,001 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 09:01:12,001 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da. 2023-10-05 09:01:12,001 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 09:01:12,002 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 09:01:12,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,002 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570. 2023-10-05 09:01:12,002 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 09:01:12,002 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 09:01:12,002 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40073,1696496401119' in zk 2023-10-05 09:01:12,002 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570. started... 2023-10-05 09:01:12,002 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 09:01:12,001 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da. started... 2023-10-05 09:01:12,001 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,003 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a54404ee4996be145e1e54cc01479570: 2023-10-05 09:01:12,003 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 44fd85ee9bbf7d274f8281f2de8ce2da: 2023-10-05 09:01:12,003 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 09:01:12,003 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,003 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,003 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 09:01:12,003 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 09:01:12,003 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 09:01:12,003 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 09:01:12,012 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 09:01:12,012 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:12,013 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 09:01:12,017 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da. completed. 2023-10-05 09:01:12,017 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da. 2023-10-05 09:01:12,017 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570. completed. 2023-10-05 09:01:12,017 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 09:01:12,017 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 09:01:12,017 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570. 2023-10-05 09:01:12,017 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,017 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 09:01:12,018 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 09:01:12,018 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 09:01:12,018 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,018 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35953,1696496401154' in zk 2023-10-05 09:01:12,018 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 09:01:12,018 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41057,1696496401070' in zk 2023-10-05 09:01:12,020 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 09:01:12,020 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 09:01:12,020 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,020 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:12,020 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,020 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:12,021 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 09:01:12,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:12,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:12,021 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 09:01:12,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:12,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:12,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:12,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:12,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:12,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35953,1696496401154': 2023-10-05 09:01:12,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35953,1696496401154' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-05 09:01:12,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:12,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:12,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:12,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:12,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:12,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:12,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:12,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41057,1696496401070': 2023-10-05 09:01:12,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41057,1696496401070' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-05 09:01:12,030 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-05 09:01:12,030 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 09:01:12,030 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 09:01:12,030 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,030 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 09:01:12,033 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,033 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,033 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:12,033 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:12,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,033 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,033 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:12,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:12,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,033 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:12,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:12,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:12,034 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:12,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:12,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:12,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:12,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:12,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:12,034 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,035 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:12,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:12,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:12,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,037 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,037 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,038 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:12,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:12,041 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:12,041 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:12,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:12,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:12,041 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:12,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:12,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:12,042 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:12,041 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:12,042 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:12,043 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:12,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:12,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:12,042 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:12,042 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:12,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:12,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:12,043 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:12,042 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,044 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,044 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,044 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 09:01:12,044 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:12,044 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,044 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,044 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,044 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,044 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:12,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:12,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 09:01:12,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,071 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:01:12,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-05 09:01:12,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-05 09:01:12,073 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 09:01:12,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,081 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-05 09:01:12,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,082 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696496471970Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696496472056 (+86 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696496472056Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696496472057 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696496472061 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696496472075 (+14 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696496472081 (+6 ms) 2023-10-05 09:01:12,084 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 09:01:12,086 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 113 msec 2023-10-05 09:01:12,273 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:01:12,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-05 09:01:12,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 09:01:12,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35953] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 09:01:12,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41057] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 09:01:12,281 DEBUG [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,281 DEBUG [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da. 2023-10-05 09:01:12,281 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 09:01:12,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 09:01:12,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696496472291 (current time:1696496472291). 2023-10-05 09:01:12,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 09:01:12,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(139): Connect 0x12677052 to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:01:12,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74cc8ea7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:01:12,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:01:12,302 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:01:12,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12677052 to 127.0.0.1:63699 2023-10-05 09:01:12,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:01:12,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(139): Connect 0x68b2e71c to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:01:12,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41feefb8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:01:12,310 DEBUG [hconnection-0x5157f896-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:01:12,312 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:01:12,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:01:12,318 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41792, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:01:12,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68b2e71c to 127.0.0.1:63699 2023-10-05 09:01:12,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:01:12,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-05 09:01:12,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 09:01:12,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 09:01:12,322 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot, current working dir path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 09:01:12,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 09:01:12,325 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 09:01:12,325 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696497072325 2023-10-05 09:01:12,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 09:01:12,325 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,326 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 09:01:12,327 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 09:01:12,327 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 09:01:12,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 09:01:12,328 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-10-05 09:01:12,329 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 09:01:12,330 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696497072330 2023-10-05 09:01:12,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,341 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-05 09:01:12,341 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:12,342 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-05 09:01:12,342 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-05 09:01:12,342 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,343 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,344 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:12,344 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:12,344 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:12,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:12,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:12,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:12,344 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:12,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:12,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:12,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,344 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,344 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,345 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,345 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 09:01:12,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-05 09:01:12,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-05 09:01:12,345 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 09:01:12,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-05 09:01:12,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,345 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 09:01:12,345 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,345 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 09:01:12,346 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 09:01:12,346 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:12,346 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,346 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 09:01:12,347 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 09:01:12,347 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 09:01:12,347 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:12,347 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,348 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 09:01:12,348 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 09:01:12,348 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:12,347 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41057,1696496401070' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 09:01:12,349 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 09:01:12,349 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 09:01:12,348 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 09:01:12,349 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35953,1696496401154' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 09:01:12,349 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40073,1696496401119' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 09:01:12,350 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,350 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:12,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:12,352 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,352 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,352 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:12,352 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,352 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:01:12,352 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,352 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:01:12,352 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,352 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:01:12,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:12,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:12,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:12,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41057,1696496401070' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-05 09:01:12,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23a7b49f[Count = 1] remaining members to acquire global barrier 2023-10-05 09:01:12,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:12,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:12,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:12,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:12,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:12,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:12,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35953,1696496401154' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-05 09:01:12,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23a7b49f[Count = 0] remaining members to acquire global barrier 2023-10-05 09:01:12,356 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-05 09:01:12,356 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,358 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,358 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,358 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,358 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,358 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 09:01:12,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,358 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 09:01:12,358 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 09:01:12,358 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 09:01:12,358 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 09:01:12,358 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 09:01:12,358 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 09:01:12,359 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 09:01:12,358 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da. 2023-10-05 09:01:12,358 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40073,1696496401119' in zk 2023-10-05 09:01:12,358 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,359 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 09:01:12,358 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570. 2023-10-05 09:01:12,359 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da. started... 2023-10-05 09:01:12,359 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570. started... 2023-10-05 09:01:12,359 INFO [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 44fd85ee9bbf7d274f8281f2de8ce2da 1/1 column families, dataSize=333 B heapSize=976 B 2023-10-05 09:01:12,359 INFO [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a54404ee4996be145e1e54cc01479570 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-10-05 09:01:12,360 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 09:01:12,360 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:12,360 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 09:01:12,376 INFO [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231005e32817345f8f4514af4564c4fe135f6b to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231005e32817345f8f4514af4564c4fe135f6b 2023-10-05 09:01:12,379 INFO [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231005ae23918028214a7b88b668f9ad9e9452 to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231005ae23918028214a7b88b668f9ad9e9452 2023-10-05 09:01:12,384 INFO [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion/44fd85ee9bbf7d274f8281f2de8ce2da/.tmp/cf/85b55289a9624acc944f08ef5dd1f1a6 2023-10-05 09:01:12,386 INFO [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a54404ee4996be145e1e54cc01479570/.tmp/cf/1489759128fd4f039099446dd777a6cd 2023-10-05 09:01:12,389 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion/44fd85ee9bbf7d274f8281f2de8ce2da/.tmp/cf/85b55289a9624acc944f08ef5dd1f1a6 as hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion/44fd85ee9bbf7d274f8281f2de8ce2da/cf/85b55289a9624acc944f08ef5dd1f1a6 2023-10-05 09:01:12,391 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a54404ee4996be145e1e54cc01479570/.tmp/cf/1489759128fd4f039099446dd777a6cd as hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a54404ee4996be145e1e54cc01479570/cf/1489759128fd4f039099446dd777a6cd 2023-10-05 09:01:12,417 INFO [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion/44fd85ee9bbf7d274f8281f2de8ce2da/cf/85b55289a9624acc944f08ef5dd1f1a6, entries=5, sequenceid=6, filesize=5.8 K 2023-10-05 09:01:12,422 INFO [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 44fd85ee9bbf7d274f8281f2de8ce2da in 63ms, sequenceid=6, compaction requested=false 2023-10-05 09:01:12,422 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-05 09:01:12,422 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 44fd85ee9bbf7d274f8281f2de8ce2da: 2023-10-05 09:01:12,422 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,422 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 09:01:12,422 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion/44fd85ee9bbf7d274f8281f2de8ce2da/cf/85b55289a9624acc944f08ef5dd1f1a6] hfiles 2023-10-05 09:01:12,422 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion/44fd85ee9bbf7d274f8281f2de8ce2da/cf/85b55289a9624acc944f08ef5dd1f1a6 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,423 INFO [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a54404ee4996be145e1e54cc01479570/cf/1489759128fd4f039099446dd777a6cd, entries=45, sequenceid=6, filesize=13.2 K 2023-10-05 09:01:12,424 INFO [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for a54404ee4996be145e1e54cc01479570 in 65ms, sequenceid=6, compaction requested=false 2023-10-05 09:01:12,425 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a54404ee4996be145e1e54cc01479570: 2023-10-05 09:01:12,425 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,425 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 09:01:12,425 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a54404ee4996be145e1e54cc01479570/cf/1489759128fd4f039099446dd777a6cd] hfiles 2023-10-05 09:01:12,425 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a54404ee4996be145e1e54cc01479570/cf/1489759128fd4f039099446dd777a6cd for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,427 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:01:12,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-05 09:01:12,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-05 09:01:12,428 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 09:01:12,433 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570. completed. 2023-10-05 09:01:12,433 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570. 2023-10-05 09:01:12,433 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da. completed. 2023-10-05 09:01:12,433 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da. 2023-10-05 09:01:12,433 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 09:01:12,433 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 09:01:12,433 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,433 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 09:01:12,433 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 09:01:12,433 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,433 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 09:01:12,433 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 09:01:12,433 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41057,1696496401070' in zk 2023-10-05 09:01:12,433 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35953,1696496401154' in zk 2023-10-05 09:01:12,435 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,435 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 09:01:12,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:12,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:12,435 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:12,435 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 09:01:12,435 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,437 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:12,435 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 09:01:12,437 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 09:01:12,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:12,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:12,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:12,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:12,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:12,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35953,1696496401154': 2023-10-05 09:01:12,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35953,1696496401154' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-05 09:01:12,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:12,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:12,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:12,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:12,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:12,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:12,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:12,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41057,1696496401070': 2023-10-05 09:01:12,444 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41057,1696496401070' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-05 09:01:12,444 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-05 09:01:12,444 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 09:01:12,444 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 09:01:12,444 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,444 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 09:01:12,449 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,449 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,449 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:12,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:12,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:12,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,449 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,449 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,450 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:12,450 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:12,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,450 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:12,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:12,450 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:12,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:12,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:12,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:12,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:12,451 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:12,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:12,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:12,452 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:12,453 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,453 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:12,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:12,456 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:12,456 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,456 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:12,456 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,456 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:12,456 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:12,456 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:12,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:12,456 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:12,456 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:12,456 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:12,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:12,456 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,456 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:12,456 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:12,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:12,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:12,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:12,456 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:12,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:12,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:12,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:12,456 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,456 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,458 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,458 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:12,458 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 09:01:12,458 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:12,458 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:12,458 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231005ae23918028214a7b88b668f9ad9e9452, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231005e32817345f8f4514af4564c4fe135f6b] mob files 2023-10-05 09:01:12,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231005ae23918028214a7b88b668f9ad9e9452 2023-10-05 09:01:12,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231005e32817345f8f4514af4564c4fe135f6b 2023-10-05 09:01:12,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,483 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-05 09:01:12,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,483 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:12,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696496472326Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696496472466 (+140 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696496472466Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1696496472466Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1696496472469 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696496472476 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696496472483 (+7 ms) 2023-10-05 09:01:12,486 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 09:01:12,487 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 160 msec 2023-10-05 09:01:12,628 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:01:12,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-05 09:01:12,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 09:01:12,657 DEBUG [Listener at jenkins-hbase4.apache.org/41667] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 09:01:12,661 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54960, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 09:01:12,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35953] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-05 09:01:12,663 DEBUG [Listener at jenkins-hbase4.apache.org/41667] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 09:01:12,665 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41808, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 09:01:12,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40073] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-05 09:01:12,666 DEBUG [Listener at jenkins-hbase4.apache.org/41667] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 09:01:12,668 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50260, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 09:01:12,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41057] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-05 09:01:12,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-05 09:01:12,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:12,673 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 09:01:12,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-10-05 09:01:12,674 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 09:01:12,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-05 09:01:12,676 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b124b62b69cd4e66f38dda8682adcd47 2023-10-05 09:01:12,676 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5099dc096eae280cdb4794864565b5df 2023-10-05 09:01:12,677 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b124b62b69cd4e66f38dda8682adcd47 empty. 2023-10-05 09:01:12,677 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5099dc096eae280cdb4794864565b5df empty. 2023-10-05 09:01:12,677 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b124b62b69cd4e66f38dda8682adcd47 2023-10-05 09:01:12,677 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5099dc096eae280cdb4794864565b5df 2023-10-05 09:01:12,677 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-05 09:01:12,686 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-10-05 09:01:12,687 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => b124b62b69cd4e66f38dda8682adcd47, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472670.b124b62b69cd4e66f38dda8682adcd47.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp 2023-10-05 09:01:12,688 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5099dc096eae280cdb4794864565b5df, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696496472670.5099dc096eae280cdb4794864565b5df.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp 2023-10-05 09:01:12,696 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472670.b124b62b69cd4e66f38dda8682adcd47.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:01:12,696 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696496472670.5099dc096eae280cdb4794864565b5df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:01:12,696 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing b124b62b69cd4e66f38dda8682adcd47, disabling compactions & flushes 2023-10-05 09:01:12,696 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 5099dc096eae280cdb4794864565b5df, disabling compactions & flushes 2023-10-05 09:01:12,696 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472670.b124b62b69cd4e66f38dda8682adcd47. 2023-10-05 09:01:12,696 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696496472670.5099dc096eae280cdb4794864565b5df. 2023-10-05 09:01:12,696 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472670.b124b62b69cd4e66f38dda8682adcd47. 2023-10-05 09:01:12,696 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696496472670.5099dc096eae280cdb4794864565b5df. 2023-10-05 09:01:12,696 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472670.b124b62b69cd4e66f38dda8682adcd47. after waiting 0 ms 2023-10-05 09:01:12,696 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696496472670.5099dc096eae280cdb4794864565b5df. after waiting 0 ms 2023-10-05 09:01:12,697 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696496472670.5099dc096eae280cdb4794864565b5df. 2023-10-05 09:01:12,697 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472670.b124b62b69cd4e66f38dda8682adcd47. 2023-10-05 09:01:12,697 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696496472670.5099dc096eae280cdb4794864565b5df. 2023-10-05 09:01:12,697 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472670.b124b62b69cd4e66f38dda8682adcd47. 2023-10-05 09:01:12,697 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 5099dc096eae280cdb4794864565b5df: 2023-10-05 09:01:12,697 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for b124b62b69cd4e66f38dda8682adcd47: 2023-10-05 09:01:12,699 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 09:01:12,699 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696496472670.5099dc096eae280cdb4794864565b5df.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696496472699"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496472699"}]},"ts":"1696496472699"} 2023-10-05 09:01:12,700 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472670.b124b62b69cd4e66f38dda8682adcd47.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696496472699"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496472699"}]},"ts":"1696496472699"} 2023-10-05 09:01:12,701 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 09:01:12,702 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 09:01:12,702 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496472702"}]},"ts":"1696496472702"} 2023-10-05 09:01:12,703 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-10-05 09:01:12,706 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 09:01:12,707 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 09:01:12,707 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 09:01:12,707 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 09:01:12,707 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 09:01:12,708 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b124b62b69cd4e66f38dda8682adcd47, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5099dc096eae280cdb4794864565b5df, ASSIGN}] 2023-10-05 09:01:12,710 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5099dc096eae280cdb4794864565b5df, ASSIGN 2023-10-05 09:01:12,710 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b124b62b69cd4e66f38dda8682adcd47, ASSIGN 2023-10-05 09:01:12,711 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5099dc096eae280cdb4794864565b5df, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40073,1696496401119; forceNewPlan=false, retain=false 2023-10-05 09:01:12,711 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b124b62b69cd4e66f38dda8682adcd47, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41057,1696496401070; forceNewPlan=false, retain=false 2023-10-05 09:01:12,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-05 09:01:12,861 INFO [jenkins-hbase4:37915] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 09:01:12,863 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=5099dc096eae280cdb4794864565b5df, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:12,863 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=b124b62b69cd4e66f38dda8682adcd47, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:12,863 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696496472670.5099dc096eae280cdb4794864565b5df.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696496472863"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496472863"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496472863"}]},"ts":"1696496472863"} 2023-10-05 09:01:12,864 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472670.b124b62b69cd4e66f38dda8682adcd47.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696496472863"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496472863"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496472863"}]},"ts":"1696496472863"} 2023-10-05 09:01:12,865 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 5099dc096eae280cdb4794864565b5df, server=jenkins-hbase4.apache.org,40073,1696496401119}] 2023-10-05 09:01:12,866 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure b124b62b69cd4e66f38dda8682adcd47, server=jenkins-hbase4.apache.org,41057,1696496401070}] 2023-10-05 09:01:12,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-05 09:01:13,019 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1696496472670.5099dc096eae280cdb4794864565b5df. 2023-10-05 09:01:13,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5099dc096eae280cdb4794864565b5df, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696496472670.5099dc096eae280cdb4794864565b5df.', STARTKEY => '2', ENDKEY => ''} 2023-10-05 09:01:13,020 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472670.b124b62b69cd4e66f38dda8682adcd47. 2023-10-05 09:01:13,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b124b62b69cd4e66f38dda8682adcd47, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472670.b124b62b69cd4e66f38dda8682adcd47.', STARTKEY => '', ENDKEY => '2'} 2023-10-05 09:01:13,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1696496472670.5099dc096eae280cdb4794864565b5df. service=AccessControlService 2023-10-05 09:01:13,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472670.b124b62b69cd4e66f38dda8682adcd47. service=AccessControlService 2023-10-05 09:01:13,020 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 09:01:13,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 09:01:13,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 5099dc096eae280cdb4794864565b5df 2023-10-05 09:01:13,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696496472670.5099dc096eae280cdb4794864565b5df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:01:13,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 b124b62b69cd4e66f38dda8682adcd47 2023-10-05 09:01:13,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5099dc096eae280cdb4794864565b5df 2023-10-05 09:01:13,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472670.b124b62b69cd4e66f38dda8682adcd47.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:01:13,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5099dc096eae280cdb4794864565b5df 2023-10-05 09:01:13,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b124b62b69cd4e66f38dda8682adcd47 2023-10-05 09:01:13,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b124b62b69cd4e66f38dda8682adcd47 2023-10-05 09:01:13,022 INFO [StoreOpener-5099dc096eae280cdb4794864565b5df-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5099dc096eae280cdb4794864565b5df 2023-10-05 09:01:13,022 INFO [StoreOpener-b124b62b69cd4e66f38dda8682adcd47-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b124b62b69cd4e66f38dda8682adcd47 2023-10-05 09:01:13,023 DEBUG [StoreOpener-5099dc096eae280cdb4794864565b5df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5099dc096eae280cdb4794864565b5df/cf 2023-10-05 09:01:13,023 DEBUG [StoreOpener-5099dc096eae280cdb4794864565b5df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5099dc096eae280cdb4794864565b5df/cf 2023-10-05 09:01:13,024 DEBUG [StoreOpener-b124b62b69cd4e66f38dda8682adcd47-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b124b62b69cd4e66f38dda8682adcd47/cf 2023-10-05 09:01:13,024 DEBUG [StoreOpener-b124b62b69cd4e66f38dda8682adcd47-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b124b62b69cd4e66f38dda8682adcd47/cf 2023-10-05 09:01:13,024 INFO [StoreOpener-5099dc096eae280cdb4794864565b5df-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5099dc096eae280cdb4794864565b5df columnFamilyName cf 2023-10-05 09:01:13,024 INFO [StoreOpener-b124b62b69cd4e66f38dda8682adcd47-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b124b62b69cd4e66f38dda8682adcd47 columnFamilyName cf 2023-10-05 09:01:13,024 INFO [StoreOpener-5099dc096eae280cdb4794864565b5df-1] regionserver.HStore(310): Store=5099dc096eae280cdb4794864565b5df/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 09:01:13,025 INFO [StoreOpener-b124b62b69cd4e66f38dda8682adcd47-1] regionserver.HStore(310): Store=b124b62b69cd4e66f38dda8682adcd47/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 09:01:13,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5099dc096eae280cdb4794864565b5df 2023-10-05 09:01:13,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5099dc096eae280cdb4794864565b5df 2023-10-05 09:01:13,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b124b62b69cd4e66f38dda8682adcd47 2023-10-05 09:01:13,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b124b62b69cd4e66f38dda8682adcd47 2023-10-05 09:01:13,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5099dc096eae280cdb4794864565b5df 2023-10-05 09:01:13,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b124b62b69cd4e66f38dda8682adcd47 2023-10-05 09:01:13,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5099dc096eae280cdb4794864565b5df/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 09:01:13,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b124b62b69cd4e66f38dda8682adcd47/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 09:01:13,030 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5099dc096eae280cdb4794864565b5df; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62830433, jitterRate=-0.06375358998775482}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 09:01:13,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5099dc096eae280cdb4794864565b5df: 2023-10-05 09:01:13,031 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b124b62b69cd4e66f38dda8682adcd47; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71872418, jitterRate=0.07098248600959778}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 09:01:13,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b124b62b69cd4e66f38dda8682adcd47: 2023-10-05 09:01:13,031 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696496472670.5099dc096eae280cdb4794864565b5df., pid=69, masterSystemTime=1696496473016 2023-10-05 09:01:13,031 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472670.b124b62b69cd4e66f38dda8682adcd47., pid=70, masterSystemTime=1696496473017 2023-10-05 09:01:13,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472670.b124b62b69cd4e66f38dda8682adcd47. 2023-10-05 09:01:13,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472670.b124b62b69cd4e66f38dda8682adcd47. 2023-10-05 09:01:13,033 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=b124b62b69cd4e66f38dda8682adcd47, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:13,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696496472670.5099dc096eae280cdb4794864565b5df. 2023-10-05 09:01:13,034 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472670.b124b62b69cd4e66f38dda8682adcd47.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696496473033"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696496473033"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696496473033"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696496473033"}]},"ts":"1696496473033"} 2023-10-05 09:01:13,034 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1696496472670.5099dc096eae280cdb4794864565b5df. 2023-10-05 09:01:13,034 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=5099dc096eae280cdb4794864565b5df, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:13,034 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696496472670.5099dc096eae280cdb4794864565b5df.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696496473034"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696496473034"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696496473034"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696496473034"}]},"ts":"1696496473034"} 2023-10-05 09:01:13,036 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-10-05 09:01:13,037 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure b124b62b69cd4e66f38dda8682adcd47, server=jenkins-hbase4.apache.org,41057,1696496401070 in 169 msec 2023-10-05 09:01:13,037 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-10-05 09:01:13,037 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 5099dc096eae280cdb4794864565b5df, server=jenkins-hbase4.apache.org,40073,1696496401119 in 171 msec 2023-10-05 09:01:13,038 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b124b62b69cd4e66f38dda8682adcd47, ASSIGN in 330 msec 2023-10-05 09:01:13,039 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-10-05 09:01:13,039 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5099dc096eae280cdb4794864565b5df, ASSIGN in 329 msec 2023-10-05 09:01:13,039 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 09:01:13,040 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496473040"}]},"ts":"1696496473040"} 2023-10-05 09:01:13,041 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-10-05 09:01:13,043 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 09:01:13,043 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-10-05 09:01:13,045 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40073] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-05 09:01:13,046 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:13,046 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:13,046 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:13,046 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:13,048 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 09:01:13,048 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 09:01:13,048 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-05 09:01:13,048 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 09:01:13,048 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 09:01:13,048 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-05 09:01:13,048 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-05 09:01:13,048 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-05 09:01:13,049 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 378 msec 2023-10-05 09:01:13,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-05 09:01:13,278 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-10-05 09:01:13,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions b124b62b69cd4e66f38dda8682adcd47, 5099dc096eae280cdb4794864565b5df 2023-10-05 09:01:13,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b124b62b69cd4e66f38dda8682adcd47, 5099dc096eae280cdb4794864565b5df], force=true 2023-10-05 09:01:13,309 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b124b62b69cd4e66f38dda8682adcd47, 5099dc096eae280cdb4794864565b5df], force=true 2023-10-05 09:01:13,309 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b124b62b69cd4e66f38dda8682adcd47, 5099dc096eae280cdb4794864565b5df], force=true 2023-10-05 09:01:13,309 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b124b62b69cd4e66f38dda8682adcd47, 5099dc096eae280cdb4794864565b5df], force=true 2023-10-05 09:01:13,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 09:01:13,330 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b124b62b69cd4e66f38dda8682adcd47, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5099dc096eae280cdb4794864565b5df, UNASSIGN}] 2023-10-05 09:01:13,332 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b124b62b69cd4e66f38dda8682adcd47, UNASSIGN 2023-10-05 09:01:13,332 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5099dc096eae280cdb4794864565b5df, UNASSIGN 2023-10-05 09:01:13,333 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=b124b62b69cd4e66f38dda8682adcd47, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:13,333 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=5099dc096eae280cdb4794864565b5df, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:13,333 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472670.b124b62b69cd4e66f38dda8682adcd47.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696496473333"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496473333"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496473333"}]},"ts":"1696496473333"} 2023-10-05 09:01:13,333 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696496472670.5099dc096eae280cdb4794864565b5df.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696496473333"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496473333"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496473333"}]},"ts":"1696496473333"} 2023-10-05 09:01:13,335 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure b124b62b69cd4e66f38dda8682adcd47, server=jenkins-hbase4.apache.org,41057,1696496401070}] 2023-10-05 09:01:13,335 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 5099dc096eae280cdb4794864565b5df, server=jenkins-hbase4.apache.org,40073,1696496401119}] 2023-10-05 09:01:13,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 09:01:13,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b124b62b69cd4e66f38dda8682adcd47 2023-10-05 09:01:13,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5099dc096eae280cdb4794864565b5df 2023-10-05 09:01:13,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b124b62b69cd4e66f38dda8682adcd47, disabling compactions & flushes 2023-10-05 09:01:13,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5099dc096eae280cdb4794864565b5df, disabling compactions & flushes 2023-10-05 09:01:13,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472670.b124b62b69cd4e66f38dda8682adcd47. 2023-10-05 09:01:13,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696496472670.5099dc096eae280cdb4794864565b5df. 2023-10-05 09:01:13,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472670.b124b62b69cd4e66f38dda8682adcd47. 2023-10-05 09:01:13,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696496472670.5099dc096eae280cdb4794864565b5df. 2023-10-05 09:01:13,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472670.b124b62b69cd4e66f38dda8682adcd47. after waiting 0 ms 2023-10-05 09:01:13,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696496472670.5099dc096eae280cdb4794864565b5df. after waiting 0 ms 2023-10-05 09:01:13,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696496472670.5099dc096eae280cdb4794864565b5df. 2023-10-05 09:01:13,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472670.b124b62b69cd4e66f38dda8682adcd47. 2023-10-05 09:01:13,490 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 5099dc096eae280cdb4794864565b5df 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-05 09:01:13,490 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing b124b62b69cd4e66f38dda8682adcd47 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-05 09:01:13,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b124b62b69cd4e66f38dda8682adcd47/.tmp/cf/1e4d2cbaf4c94144922dad4f79028f8d 2023-10-05 09:01:13,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5099dc096eae280cdb4794864565b5df/.tmp/cf/91d5b517e35f4c68bb82f0e620fb9869 2023-10-05 09:01:13,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b124b62b69cd4e66f38dda8682adcd47/.tmp/cf/1e4d2cbaf4c94144922dad4f79028f8d as hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b124b62b69cd4e66f38dda8682adcd47/cf/1e4d2cbaf4c94144922dad4f79028f8d 2023-10-05 09:01:13,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5099dc096eae280cdb4794864565b5df/.tmp/cf/91d5b517e35f4c68bb82f0e620fb9869 as hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5099dc096eae280cdb4794864565b5df/cf/91d5b517e35f4c68bb82f0e620fb9869 2023-10-05 09:01:13,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b124b62b69cd4e66f38dda8682adcd47/cf/1e4d2cbaf4c94144922dad4f79028f8d, entries=1, sequenceid=5, filesize=4.7 K 2023-10-05 09:01:13,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for b124b62b69cd4e66f38dda8682adcd47 in 28ms, sequenceid=5, compaction requested=false 2023-10-05 09:01:13,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-05 09:01:13,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5099dc096eae280cdb4794864565b5df/cf/91d5b517e35f4c68bb82f0e620fb9869, entries=1, sequenceid=5, filesize=4.7 K 2023-10-05 09:01:13,522 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 5099dc096eae280cdb4794864565b5df in 32ms, sequenceid=5, compaction requested=false 2023-10-05 09:01:13,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b124b62b69cd4e66f38dda8682adcd47/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-05 09:01:13,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5099dc096eae280cdb4794864565b5df/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-05 09:01:13,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 09:01:13,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 09:01:13,535 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472670.b124b62b69cd4e66f38dda8682adcd47. 2023-10-05 09:01:13,535 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696496472670.5099dc096eae280cdb4794864565b5df. 2023-10-05 09:01:13,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b124b62b69cd4e66f38dda8682adcd47: 2023-10-05 09:01:13,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5099dc096eae280cdb4794864565b5df: 2023-10-05 09:01:13,536 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5099dc096eae280cdb4794864565b5df 2023-10-05 09:01:13,536 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=5099dc096eae280cdb4794864565b5df, regionState=CLOSED 2023-10-05 09:01:13,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b124b62b69cd4e66f38dda8682adcd47 2023-10-05 09:01:13,537 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696496472670.5099dc096eae280cdb4794864565b5df.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696496473536"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496473536"}]},"ts":"1696496473536"} 2023-10-05 09:01:13,537 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=b124b62b69cd4e66f38dda8682adcd47, regionState=CLOSED 2023-10-05 09:01:13,538 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472670.b124b62b69cd4e66f38dda8682adcd47.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696496473537"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496473537"}]},"ts":"1696496473537"} 2023-10-05 09:01:13,540 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-10-05 09:01:13,540 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 5099dc096eae280cdb4794864565b5df, server=jenkins-hbase4.apache.org,40073,1696496401119 in 203 msec 2023-10-05 09:01:13,540 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-10-05 09:01:13,541 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure b124b62b69cd4e66f38dda8682adcd47, server=jenkins-hbase4.apache.org,41057,1696496401070 in 204 msec 2023-10-05 09:01:13,541 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5099dc096eae280cdb4794864565b5df, UNASSIGN in 210 msec 2023-10-05 09:01:13,542 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-10-05 09:01:13,542 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b124b62b69cd4e66f38dda8682adcd47, UNASSIGN in 214 msec 2023-10-05 09:01:13,586 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e35722c68ac527e8540864bd470c1b0/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-10-05 09:01:13,588 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472670.b124b62b69cd4e66f38dda8682adcd47.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-05 09:01:13,588 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696496472670.5099dc096eae280cdb4794864565b5df.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-05 09:01:13,589 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472671.1e35722c68ac527e8540864bd470c1b0.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-05 09:01:13,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 09:01:13,638 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1e35722c68ac527e8540864bd470c1b0, ASSIGN}] 2023-10-05 09:01:13,639 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1e35722c68ac527e8540864bd470c1b0, ASSIGN 2023-10-05 09:01:13,639 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1e35722c68ac527e8540864bd470c1b0, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,41057,1696496401070; forceNewPlan=false, retain=false 2023-10-05 09:01:13,790 INFO [jenkins-hbase4:37915] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-05 09:01:13,791 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=1e35722c68ac527e8540864bd470c1b0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:13,792 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472671.1e35722c68ac527e8540864bd470c1b0.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696496473791"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496473791"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496473791"}]},"ts":"1696496473791"} 2023-10-05 09:01:13,793 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 1e35722c68ac527e8540864bd470c1b0, server=jenkins-hbase4.apache.org,41057,1696496401070}] 2023-10-05 09:01:13,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 09:01:13,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472671.1e35722c68ac527e8540864bd470c1b0. 2023-10-05 09:01:13,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1e35722c68ac527e8540864bd470c1b0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472671.1e35722c68ac527e8540864bd470c1b0.', STARTKEY => '', ENDKEY => ''} 2023-10-05 09:01:13,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472671.1e35722c68ac527e8540864bd470c1b0. service=AccessControlService 2023-10-05 09:01:13,949 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 09:01:13,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 1e35722c68ac527e8540864bd470c1b0 2023-10-05 09:01:13,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472671.1e35722c68ac527e8540864bd470c1b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:01:13,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1e35722c68ac527e8540864bd470c1b0 2023-10-05 09:01:13,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1e35722c68ac527e8540864bd470c1b0 2023-10-05 09:01:13,950 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e35722c68ac527e8540864bd470c1b0/.regioninfo 2023-10-05 09:01:13,961 INFO [StoreOpener-1e35722c68ac527e8540864bd470c1b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1e35722c68ac527e8540864bd470c1b0 2023-10-05 09:01:13,962 DEBUG [StoreOpener-1e35722c68ac527e8540864bd470c1b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e35722c68ac527e8540864bd470c1b0/cf 2023-10-05 09:01:13,962 DEBUG [StoreOpener-1e35722c68ac527e8540864bd470c1b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e35722c68ac527e8540864bd470c1b0/cf 2023-10-05 09:01:13,962 INFO [StoreOpener-1e35722c68ac527e8540864bd470c1b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e35722c68ac527e8540864bd470c1b0 columnFamilyName cf 2023-10-05 09:01:13,990 DEBUG [StoreOpener-1e35722c68ac527e8540864bd470c1b0-1] regionserver.HStore(539): loaded hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e35722c68ac527e8540864bd470c1b0/cf/1e4d2cbaf4c94144922dad4f79028f8d.b124b62b69cd4e66f38dda8682adcd47->hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b124b62b69cd4e66f38dda8682adcd47/cf/1e4d2cbaf4c94144922dad4f79028f8d-top 2023-10-05 09:01:13,996 DEBUG [StoreOpener-1e35722c68ac527e8540864bd470c1b0-1] regionserver.HStore(539): loaded hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e35722c68ac527e8540864bd470c1b0/cf/91d5b517e35f4c68bb82f0e620fb9869.5099dc096eae280cdb4794864565b5df->hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5099dc096eae280cdb4794864565b5df/cf/91d5b517e35f4c68bb82f0e620fb9869-top 2023-10-05 09:01:13,996 INFO [StoreOpener-1e35722c68ac527e8540864bd470c1b0-1] regionserver.HStore(310): Store=1e35722c68ac527e8540864bd470c1b0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 09:01:13,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e35722c68ac527e8540864bd470c1b0 2023-10-05 09:01:13,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e35722c68ac527e8540864bd470c1b0 2023-10-05 09:01:14,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1e35722c68ac527e8540864bd470c1b0 2023-10-05 09:01:14,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1e35722c68ac527e8540864bd470c1b0; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59855480, jitterRate=-0.10808384418487549}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 09:01:14,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1e35722c68ac527e8540864bd470c1b0: 2023-10-05 09:01:14,004 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472671.1e35722c68ac527e8540864bd470c1b0., pid=77, masterSystemTime=1696496473945 2023-10-05 09:01:14,004 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472671.1e35722c68ac527e8540864bd470c1b0.,because compaction is disabled. 2023-10-05 09:01:14,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472671.1e35722c68ac527e8540864bd470c1b0. 2023-10-05 09:01:14,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472671.1e35722c68ac527e8540864bd470c1b0. 2023-10-05 09:01:14,006 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=1e35722c68ac527e8540864bd470c1b0, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:14,006 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472671.1e35722c68ac527e8540864bd470c1b0.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696496474006"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696496474006"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696496474006"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696496474006"}]},"ts":"1696496474006"} 2023-10-05 09:01:14,010 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-05 09:01:14,010 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 1e35722c68ac527e8540864bd470c1b0, server=jenkins-hbase4.apache.org,41057,1696496401070 in 215 msec 2023-10-05 09:01:14,011 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-10-05 09:01:14,011 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1e35722c68ac527e8540864bd470c1b0, ASSIGN in 372 msec 2023-10-05 09:01:14,013 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b124b62b69cd4e66f38dda8682adcd47, 5099dc096eae280cdb4794864565b5df], force=true in 709 msec 2023-10-05 09:01:14,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 09:01:14,417 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-10-05 09:01:14,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-05 09:01:14,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696496474417 (current time:1696496474417). 2023-10-05 09:01:14,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 09:01:14,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(139): Connect 0x7bd8828a to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:01:14,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e67f527, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:01:14,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:01:14,430 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50272, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:01:14,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7bd8828a to 127.0.0.1:63699 2023-10-05 09:01:14,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:01:14,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(139): Connect 0x0228543e to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:01:14,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ddb4a23, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:01:14,439 DEBUG [hconnection-0x7cd44e72-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:01:14,441 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50284, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:01:14,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:01:14,447 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:01:14,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0228543e to 127.0.0.1:63699 2023-10-05 09:01:14,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:01:14,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-05 09:01:14,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 09:01:14,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-05 09:01:14,452 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot, current working dir path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 09:01:14,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-05 09:01:14,454 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-05 09:01:14,455 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1696497074455 2023-10-05 09:01:14,455 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-05 09:01:14,458 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 09:01:14,458 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 09:01:14,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-05 09:01:14,459 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-05 09:01:14,460 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-10-05 09:01:14,461 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-05 09:01:14,462 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1696497074462 2023-10-05 09:01:14,470 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,470 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-10-05 09:01:14,470 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:14,471 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-10-05 09:01:14,471 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-10-05 09:01:14,472 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,472 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,479 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:14,479 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:14,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:14,479 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:14,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:14,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:14,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:14,479 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:14,479 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:14,479 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 09:01:14,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:14,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:14,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,480 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,480 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,480 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-05 09:01:14,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-05 09:01:14,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,480 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-05 09:01:14,480 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-05 09:01:14,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-05 09:01:14,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,480 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,481 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,480 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-05 09:01:14,481 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-05 09:01:14,481 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:14,481 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,481 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-05 09:01:14,482 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-05 09:01:14,482 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:14,482 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-05 09:01:14,483 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-05 09:01:14,484 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-05 09:01:14,484 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41057,1696496401070' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-05 09:01:14,482 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:14,483 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-05 09:01:14,484 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-05 09:01:14,485 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-05 09:01:14,485 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35953,1696496401154' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-05 09:01:14,485 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40073,1696496401119' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-05 09:01:14,486 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:14,486 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:14,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:14,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:14,487 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,488 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,488 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,488 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:01:14,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:14,488 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,488 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:01:14,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:14,488 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,488 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:01:14,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:14,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:14,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:14,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:14,490 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41057,1696496401070' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-10-05 09:01:14,490 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38823bf9[Count = 0] remaining members to acquire global barrier 2023-10-05 09:01:14,490 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-10-05 09:01:14,490 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,492 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,492 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,492 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,492 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-05 09:01:14,492 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-05 09:01:14,492 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-05 09:01:14,492 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:14,493 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 09:01:14,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,492 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40073,1696496401119' in zk 2023-10-05 09:01:14,493 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-05 09:01:14,492 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-05 09:01:14,493 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35953,1696496401154' in zk 2023-10-05 09:01:14,493 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 09:01:14,493 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 09:01:14,493 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472671.1e35722c68ac527e8540864bd470c1b0. 2023-10-05 09:01:14,493 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472671.1e35722c68ac527e8540864bd470c1b0. started... 2023-10-05 09:01:14,495 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1e35722c68ac527e8540864bd470c1b0: 2023-10-05 09:01:14,495 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-05 09:01:14,495 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:14,495 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-05 09:01:14,495 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472671.1e35722c68ac527e8540864bd470c1b0.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,496 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 09:01:14,496 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-05 09:01:14,496 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:14,496 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-05 09:01:14,496 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e35722c68ac527e8540864bd470c1b0/cf/1e4d2cbaf4c94144922dad4f79028f8d.b124b62b69cd4e66f38dda8682adcd47->hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b124b62b69cd4e66f38dda8682adcd47/cf/1e4d2cbaf4c94144922dad4f79028f8d-top, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e35722c68ac527e8540864bd470c1b0/cf/91d5b517e35f4c68bb82f0e620fb9869.5099dc096eae280cdb4794864565b5df->hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5099dc096eae280cdb4794864565b5df/cf/91d5b517e35f4c68bb82f0e620fb9869-top] hfiles 2023-10-05 09:01:14,499 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e35722c68ac527e8540864bd470c1b0/cf/1e4d2cbaf4c94144922dad4f79028f8d.b124b62b69cd4e66f38dda8682adcd47 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,500 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e35722c68ac527e8540864bd470c1b0/cf/91d5b517e35f4c68bb82f0e620fb9869.5099dc096eae280cdb4794864565b5df for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,508 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472671.1e35722c68ac527e8540864bd470c1b0. completed. 2023-10-05 09:01:14,508 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472671.1e35722c68ac527e8540864bd470c1b0. 2023-10-05 09:01:14,508 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 09:01:14,508 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 09:01:14,508 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:14,508 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-05 09:01:14,508 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,41057,1696496401070' in zk 2023-10-05 09:01:14,514 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-05 09:01:14,514 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:14,514 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:14,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:14,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:14,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:14,514 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-05 09:01:14,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:14,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:14,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:14,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:14,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:14,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:14,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:14,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:14,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:14,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,41057,1696496401070': 2023-10-05 09:01:14,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41057,1696496401070' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-10-05 09:01:14,518 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-10-05 09:01:14,518 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 09:01:14,518 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 09:01:14,518 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,518 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 09:01:14,520 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,520 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,520 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,520 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:14,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:14,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:14,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,520 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:14,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:14,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:14,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:14,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:14,521 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:14,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:14,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,521 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:14,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:14,522 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:14,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:14,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:14,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:14,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:14,523 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:14,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,524 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:14,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:14,524 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:14,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:14,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:14,527 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:14,527 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:14,527 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:14,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:14,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:14,528 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:14,527 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:14,528 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,528 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:14,528 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:14,528 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,528 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:14,528 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,528 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:14,528 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:14,528 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,528 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,528 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:14,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:14,528 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:14,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:14,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:14,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:14,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:14,529 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,532 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,532 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:14,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,532 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:14,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 because node does not exist (not an error) 2023-10-05 09:01:14,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:14,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:14,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:14,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:14,558 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:01:14,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-05 09:01:14,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-10-05 09:01:14,560 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 09:01:14,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,561 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-10-05 09:01:14,561 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,561 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,561 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1696496474455Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696496474528 (+73 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696496474528Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696496474532 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696496474552 (+20 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1696496474561 (+9 ms) 2023-10-05 09:01:14,564 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-05 09:01:14,566 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 106 msec 2023-10-05 09:01:14,760 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:01:14,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-05 09:01:14,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 09:01:14,761 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496474761 2023-10-05 09:01:14,761 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45983, tgtDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496474761, rawTgtDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496474761, srcFsUri=hdfs://localhost:45983, srcDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c 2023-10-05 09:01:14,783 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45983, inputRoot=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c 2023-10-05 09:01:14,783 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1234076891_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496474761, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496474761/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,783 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45983, inputRoot=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c, snapshotDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-10-05 09:01:14,792 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496474761/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:14,811 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:14,811 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:14,812 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:14,812 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:14,812 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:14,813 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:14,813 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:14,880 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/hadoop-3418627156220870154.jar 2023-10-05 09:01:14,880 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:14,881 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:14,881 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:14,881 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:14,882 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:14,882 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:14,882 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 09:01:14,883 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 09:01:14,883 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 09:01:14,883 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 09:01:14,884 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 09:01:14,884 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 09:01:14,884 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 09:01:14,885 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 09:01:14,885 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 09:01:14,885 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 09:01:14,886 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:01:14,886 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:01:14,887 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 09:01:14,887 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:01:14,887 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:01:14,887 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 09:01:14,888 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 09:01:15,159 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0004_000001 (auth:SIMPLE) 2023-10-05 09:01:15,247 WARN [Listener at jenkins-hbase4.apache.org/41667] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 09:01:15,249 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-10-05 09:01:15,250 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-10-05 09:01:15,308 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 09:01:15,308 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 09:01:16,034 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0005_000001 (auth:SIMPLE) 2023-10-05 09:01:16,604 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 09:01:19,709 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0005_000001 (auth:SIMPLE) 2023-10-05 09:01:21,913 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0005_000001 (auth:SIMPLE) 2023-10-05 09:01:24,235 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0005_000001 (auth:SIMPLE) 2023-10-05 09:01:25,403 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 09:01:25,406 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 09:01:25,414 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:25,415 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 09:01:25,415 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 09:01:25,415 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_795266163_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:25,416 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-05 09:01:25,416 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-05 09:01:25,416 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_795266163_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496474761/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496474761/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:25,416 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496474761/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-05 09:01:25,416 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496474761/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-05 09:01:25,422 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:25,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:25,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:25,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-05 09:01:25,427 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496485427"}]},"ts":"1696496485427"} 2023-10-05 09:01:25,428 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-10-05 09:01:25,430 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-10-05 09:01:25,431 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1e35722c68ac527e8540864bd470c1b0, UNASSIGN}] 2023-10-05 09:01:25,433 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1e35722c68ac527e8540864bd470c1b0, UNASSIGN 2023-10-05 09:01:25,433 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=1e35722c68ac527e8540864bd470c1b0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:25,434 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472671.1e35722c68ac527e8540864bd470c1b0.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696496485433"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496485433"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496485433"}]},"ts":"1696496485433"} 2023-10-05 09:01:25,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 1e35722c68ac527e8540864bd470c1b0, server=jenkins-hbase4.apache.org,41057,1696496401070}] 2023-10-05 09:01:25,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-05 09:01:25,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1e35722c68ac527e8540864bd470c1b0 2023-10-05 09:01:25,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1e35722c68ac527e8540864bd470c1b0, disabling compactions & flushes 2023-10-05 09:01:25,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472671.1e35722c68ac527e8540864bd470c1b0. 2023-10-05 09:01:25,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472671.1e35722c68ac527e8540864bd470c1b0. 2023-10-05 09:01:25,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472671.1e35722c68ac527e8540864bd470c1b0. after waiting 0 ms 2023-10-05 09:01:25,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472671.1e35722c68ac527e8540864bd470c1b0. 2023-10-05 09:01:25,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e35722c68ac527e8540864bd470c1b0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-10-05 09:01:25,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 09:01:25,598 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472671.1e35722c68ac527e8540864bd470c1b0. 2023-10-05 09:01:25,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1e35722c68ac527e8540864bd470c1b0: 2023-10-05 09:01:25,599 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1e35722c68ac527e8540864bd470c1b0 2023-10-05 09:01:25,600 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=1e35722c68ac527e8540864bd470c1b0, regionState=CLOSED 2023-10-05 09:01:25,600 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472671.1e35722c68ac527e8540864bd470c1b0.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696496485600"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496485600"}]},"ts":"1696496485600"} 2023-10-05 09:01:25,602 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-10-05 09:01:25,603 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 1e35722c68ac527e8540864bd470c1b0, server=jenkins-hbase4.apache.org,41057,1696496401070 in 166 msec 2023-10-05 09:01:25,604 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-10-05 09:01:25,604 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1e35722c68ac527e8540864bd470c1b0, UNASSIGN in 172 msec 2023-10-05 09:01:25,604 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496485604"}]},"ts":"1696496485604"} 2023-10-05 09:01:25,605 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-10-05 09:01:25,607 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-10-05 09:01:25,609 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 185 msec 2023-10-05 09:01:25,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-05 09:01:25,729 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-10-05 09:01:25,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:25,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:25,732 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:25,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:25,733 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:25,735 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40073] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:25,737 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5099dc096eae280cdb4794864565b5df 2023-10-05 09:01:25,737 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e35722c68ac527e8540864bd470c1b0 2023-10-05 09:01:25,737 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b124b62b69cd4e66f38dda8682adcd47 2023-10-05 09:01:25,738 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:25,738 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:25,738 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:25,738 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:25,739 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-05 09:01:25,739 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5099dc096eae280cdb4794864565b5df/cf, FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5099dc096eae280cdb4794864565b5df/recovered.edits] 2023-10-05 09:01:25,740 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:25,740 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-10-05 09:01:25,740 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-10-05 09:01:25,740 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:25,740 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 09:01:25,740 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:25,740 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:25,740 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:25,740 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-10-05 09:01:25,740 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 09:01:25,740 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 09:01:25,740 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e35722c68ac527e8540864bd470c1b0/cf, FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e35722c68ac527e8540864bd470c1b0/recovered.edits] 2023-10-05 09:01:25,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-05 09:01:25,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 09:01:25,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 09:01:25,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 09:01:25,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 09:01:25,744 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b124b62b69cd4e66f38dda8682adcd47/cf, FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b124b62b69cd4e66f38dda8682adcd47/recovered.edits] 2023-10-05 09:01:25,745 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5099dc096eae280cdb4794864565b5df/cf/91d5b517e35f4c68bb82f0e620fb9869 to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5099dc096eae280cdb4794864565b5df/cf/91d5b517e35f4c68bb82f0e620fb9869 2023-10-05 09:01:25,747 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e35722c68ac527e8540864bd470c1b0/cf/1e4d2cbaf4c94144922dad4f79028f8d.b124b62b69cd4e66f38dda8682adcd47 to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e35722c68ac527e8540864bd470c1b0/cf/1e4d2cbaf4c94144922dad4f79028f8d.b124b62b69cd4e66f38dda8682adcd47 2023-10-05 09:01:25,749 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5099dc096eae280cdb4794864565b5df/recovered.edits/8.seqid to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5099dc096eae280cdb4794864565b5df/recovered.edits/8.seqid 2023-10-05 09:01:25,749 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e35722c68ac527e8540864bd470c1b0/cf/91d5b517e35f4c68bb82f0e620fb9869.5099dc096eae280cdb4794864565b5df to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e35722c68ac527e8540864bd470c1b0/cf/91d5b517e35f4c68bb82f0e620fb9869.5099dc096eae280cdb4794864565b5df 2023-10-05 09:01:25,749 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b124b62b69cd4e66f38dda8682adcd47/cf/1e4d2cbaf4c94144922dad4f79028f8d to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b124b62b69cd4e66f38dda8682adcd47/cf/1e4d2cbaf4c94144922dad4f79028f8d 2023-10-05 09:01:25,750 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5099dc096eae280cdb4794864565b5df 2023-10-05 09:01:25,752 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e35722c68ac527e8540864bd470c1b0/recovered.edits/12.seqid to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e35722c68ac527e8540864bd470c1b0/recovered.edits/12.seqid 2023-10-05 09:01:25,752 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b124b62b69cd4e66f38dda8682adcd47/recovered.edits/8.seqid to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b124b62b69cd4e66f38dda8682adcd47/recovered.edits/8.seqid 2023-10-05 09:01:25,753 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e35722c68ac527e8540864bd470c1b0 2023-10-05 09:01:25,753 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b124b62b69cd4e66f38dda8682adcd47 2023-10-05 09:01:25,753 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-05 09:01:25,755 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:25,757 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-10-05 09:01:25,759 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-10-05 09:01:25,760 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:25,760 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-10-05 09:01:25,760 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472671.1e35722c68ac527e8540864bd470c1b0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696496485760"}]},"ts":"9223372036854775807"} 2023-10-05 09:01:25,761 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-05 09:01:25,761 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1e35722c68ac527e8540864bd470c1b0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696496472671.1e35722c68ac527e8540864bd470c1b0.', STARTKEY => '', ENDKEY => ''}] 2023-10-05 09:01:25,761 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-10-05 09:01:25,762 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696496485762"}]},"ts":"9223372036854775807"} 2023-10-05 09:01:25,763 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-10-05 09:01:25,764 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:25,766 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 35 msec 2023-10-05 09:01:25,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-05 09:01:25,842 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-10-05 09:01:25,843 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:25,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:25,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:25,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-05 09:01:25,847 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496485847"}]},"ts":"1696496485847"} 2023-10-05 09:01:25,848 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-10-05 09:01:25,850 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-10-05 09:01:25,850 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=44fd85ee9bbf7d274f8281f2de8ce2da, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a54404ee4996be145e1e54cc01479570, UNASSIGN}] 2023-10-05 09:01:25,852 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=44fd85ee9bbf7d274f8281f2de8ce2da, UNASSIGN 2023-10-05 09:01:25,852 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a54404ee4996be145e1e54cc01479570, UNASSIGN 2023-10-05 09:01:25,853 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=44fd85ee9bbf7d274f8281f2de8ce2da, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:25,853 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=a54404ee4996be145e1e54cc01479570, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:25,853 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696496485853"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496485853"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496485853"}]},"ts":"1696496485853"} 2023-10-05 09:01:25,853 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696496485853"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496485853"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496485853"}]},"ts":"1696496485853"} 2023-10-05 09:01:25,854 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 44fd85ee9bbf7d274f8281f2de8ce2da, server=jenkins-hbase4.apache.org,35953,1696496401154}] 2023-10-05 09:01:25,855 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure a54404ee4996be145e1e54cc01479570, server=jenkins-hbase4.apache.org,41057,1696496401070}] 2023-10-05 09:01:25,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-05 09:01:26,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 44fd85ee9bbf7d274f8281f2de8ce2da 2023-10-05 09:01:26,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 44fd85ee9bbf7d274f8281f2de8ce2da, disabling compactions & flushes 2023-10-05 09:01:26,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da. 2023-10-05 09:01:26,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da. 2023-10-05 09:01:26,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da. after waiting 0 ms 2023-10-05 09:01:26,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da. 2023-10-05 09:01:26,009 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a54404ee4996be145e1e54cc01479570 2023-10-05 09:01:26,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a54404ee4996be145e1e54cc01479570, disabling compactions & flushes 2023-10-05 09:01:26,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570. 2023-10-05 09:01:26,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570. 2023-10-05 09:01:26,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570. after waiting 0 ms 2023-10-05 09:01:26,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570. 2023-10-05 09:01:26,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion/a54404ee4996be145e1e54cc01479570/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 09:01:26,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithMergeRegion/44fd85ee9bbf7d274f8281f2de8ce2da/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 09:01:26,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 09:01:26,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 09:01:26,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da. 2023-10-05 09:01:26,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 44fd85ee9bbf7d274f8281f2de8ce2da: 2023-10-05 09:01:26,020 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570. 2023-10-05 09:01:26,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a54404ee4996be145e1e54cc01479570: 2023-10-05 09:01:26,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 44fd85ee9bbf7d274f8281f2de8ce2da 2023-10-05 09:01:26,022 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=44fd85ee9bbf7d274f8281f2de8ce2da, regionState=CLOSED 2023-10-05 09:01:26,022 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696496486022"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496486022"}]},"ts":"1696496486022"} 2023-10-05 09:01:26,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a54404ee4996be145e1e54cc01479570 2023-10-05 09:01:26,022 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=a54404ee4996be145e1e54cc01479570, regionState=CLOSED 2023-10-05 09:01:26,022 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696496486022"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496486022"}]},"ts":"1696496486022"} 2023-10-05 09:01:26,024 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-10-05 09:01:26,025 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 44fd85ee9bbf7d274f8281f2de8ce2da, server=jenkins-hbase4.apache.org,35953,1696496401154 in 169 msec 2023-10-05 09:01:26,025 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-10-05 09:01:26,025 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure a54404ee4996be145e1e54cc01479570, server=jenkins-hbase4.apache.org,41057,1696496401070 in 169 msec 2023-10-05 09:01:26,026 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=44fd85ee9bbf7d274f8281f2de8ce2da, UNASSIGN in 175 msec 2023-10-05 09:01:26,026 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-10-05 09:01:26,026 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a54404ee4996be145e1e54cc01479570, UNASSIGN in 175 msec 2023-10-05 09:01:26,027 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496486027"}]},"ts":"1696496486027"} 2023-10-05 09:01:26,028 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-10-05 09:01:26,032 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-10-05 09:01:26,033 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 189 msec 2023-10-05 09:01:26,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-05 09:01:26,149 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-10-05 09:01:26,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:26,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:26,153 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:26,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:26,153 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:26,155 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40073] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:26,157 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:26,157 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:26,157 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:26,157 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:26,157 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/44fd85ee9bbf7d274f8281f2de8ce2da 2023-10-05 09:01:26,157 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-05 09:01:26,157 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-05 09:01:26,158 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-05 09:01:26,157 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-05 09:01:26,157 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a54404ee4996be145e1e54cc01479570 2023-10-05 09:01:26,159 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:26,159 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:26,159 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:26,159 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:26,159 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/44fd85ee9bbf7d274f8281f2de8ce2da/cf, FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/44fd85ee9bbf7d274f8281f2de8ce2da/recovered.edits] 2023-10-05 09:01:26,159 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:26,160 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:26,160 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:26,160 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:26,160 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a54404ee4996be145e1e54cc01479570/cf, FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a54404ee4996be145e1e54cc01479570/recovered.edits] 2023-10-05 09:01:26,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-05 09:01:26,164 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/44fd85ee9bbf7d274f8281f2de8ce2da/cf/85b55289a9624acc944f08ef5dd1f1a6 to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/44fd85ee9bbf7d274f8281f2de8ce2da/cf/85b55289a9624acc944f08ef5dd1f1a6 2023-10-05 09:01:26,164 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a54404ee4996be145e1e54cc01479570/cf/1489759128fd4f039099446dd777a6cd to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a54404ee4996be145e1e54cc01479570/cf/1489759128fd4f039099446dd777a6cd 2023-10-05 09:01:26,167 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/44fd85ee9bbf7d274f8281f2de8ce2da/recovered.edits/9.seqid to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/44fd85ee9bbf7d274f8281f2de8ce2da/recovered.edits/9.seqid 2023-10-05 09:01:26,167 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a54404ee4996be145e1e54cc01479570/recovered.edits/9.seqid to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a54404ee4996be145e1e54cc01479570/recovered.edits/9.seqid 2023-10-05 09:01:26,167 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/44fd85ee9bbf7d274f8281f2de8ce2da 2023-10-05 09:01:26,168 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a54404ee4996be145e1e54cc01479570 2023-10-05 09:01:26,168 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-05 09:01:26,168 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-05 09:01:26,169 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-10-05 09:01:26,172 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231005ae23918028214a7b88b668f9ad9e9452 to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231005ae23918028214a7b88b668f9ad9e9452 2023-10-05 09:01:26,173 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231005e32817345f8f4514af4564c4fe135f6b to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231005e32817345f8f4514af4564c4fe135f6b 2023-10-05 09:01:26,173 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-05 09:01:26,175 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:26,177 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-10-05 09:01:26,179 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-10-05 09:01:26,180 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:26,180 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-10-05 09:01:26,180 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696496486180"}]},"ts":"9223372036854775807"} 2023-10-05 09:01:26,180 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696496486180"}]},"ts":"9223372036854775807"} 2023-10-05 09:01:26,181 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 09:01:26,181 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 44fd85ee9bbf7d274f8281f2de8ce2da, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696496471313.44fd85ee9bbf7d274f8281f2de8ce2da.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a54404ee4996be145e1e54cc01479570, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696496471313.a54404ee4996be145e1e54cc01479570.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 09:01:26,181 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-10-05 09:01:26,182 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696496486181"}]},"ts":"9223372036854775807"} 2023-10-05 09:01:26,183 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-10-05 09:01:26,185 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:26,186 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 35 msec 2023-10-05 09:01:26,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-05 09:01:26,262 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-10-05 09:01:26,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-05 09:01:26,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:26,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-05 09:01:26,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 09:01:26,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-10-05 09:01:26,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 09:01:26,300 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=761 (was 751) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_795266163_17 at /127.0.0.1:34806 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1781504564_1 at /127.0.0.1:35440 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:37169 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x5555080-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5555080-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_795266163_17 at /127.0.0.1:34970 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1781504564_1 at /127.0.0.1:38812 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5555080-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5555080-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5555080-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3838 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_795266163_17 at /127.0.0.1:51962 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5555080-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=913 (was 907) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=184 (was 210), ProcessCount=167 (was 167), AvailableMemoryMB=5731 (was 5796) 2023-10-05 09:01:26,301 WARN [Listener at jenkins-hbase4.apache.org/41667] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-10-05 09:01:26,319 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=761, OpenFileDescriptor=913, MaxFileDescriptor=60000, SystemLoadAverage=184, ProcessCount=167, AvailableMemoryMB=5730 2023-10-05 09:01:26,319 WARN [Listener at jenkins-hbase4.apache.org/41667] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-10-05 09:01:26,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 09:01:26,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 09:01:26,323 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 09:01:26,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-10-05 09:01:26,323 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 09:01:26,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-05 09:01:26,325 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ad27d33d1643132528cf9a61aa1ef72 2023-10-05 09:01:26,325 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testEmptyExportFileSystemState/07b7de0763af186139b8c600be381799 2023-10-05 09:01:26,326 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testEmptyExportFileSystemState/07b7de0763af186139b8c600be381799 empty. 2023-10-05 09:01:26,326 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ad27d33d1643132528cf9a61aa1ef72 empty. 2023-10-05 09:01:26,326 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testEmptyExportFileSystemState/07b7de0763af186139b8c600be381799 2023-10-05 09:01:26,326 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ad27d33d1643132528cf9a61aa1ef72 2023-10-05 09:01:26,327 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-05 09:01:26,337 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-05 09:01:26,338 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6ad27d33d1643132528cf9a61aa1ef72, NAME => 'testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp 2023-10-05 09:01:26,338 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 07b7de0763af186139b8c600be381799, NAME => 'testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp 2023-10-05 09:01:26,350 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:01:26,350 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 6ad27d33d1643132528cf9a61aa1ef72, disabling compactions & flushes 2023-10-05 09:01:26,350 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72. 2023-10-05 09:01:26,350 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72. 2023-10-05 09:01:26,350 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72. after waiting 0 ms 2023-10-05 09:01:26,351 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72. 2023-10-05 09:01:26,351 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72. 2023-10-05 09:01:26,351 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 6ad27d33d1643132528cf9a61aa1ef72: 2023-10-05 09:01:26,353 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:01:26,353 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 07b7de0763af186139b8c600be381799, disabling compactions & flushes 2023-10-05 09:01:26,353 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799. 2023-10-05 09:01:26,353 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799. 2023-10-05 09:01:26,353 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799. after waiting 0 ms 2023-10-05 09:01:26,353 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799. 2023-10-05 09:01:26,353 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799. 2023-10-05 09:01:26,353 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 07b7de0763af186139b8c600be381799: 2023-10-05 09:01:26,355 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 09:01:26,356 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696496486356"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496486356"}]},"ts":"1696496486356"} 2023-10-05 09:01:26,356 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696496486356"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496486356"}]},"ts":"1696496486356"} 2023-10-05 09:01:26,358 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 09:01:26,358 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 09:01:26,358 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496486358"}]},"ts":"1696496486358"} 2023-10-05 09:01:26,360 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-10-05 09:01:26,362 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 09:01:26,363 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 09:01:26,364 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 09:01:26,364 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 09:01:26,364 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 09:01:26,364 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ad27d33d1643132528cf9a61aa1ef72, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=07b7de0763af186139b8c600be381799, ASSIGN}] 2023-10-05 09:01:26,366 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=07b7de0763af186139b8c600be381799, ASSIGN 2023-10-05 09:01:26,366 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ad27d33d1643132528cf9a61aa1ef72, ASSIGN 2023-10-05 09:01:26,367 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=07b7de0763af186139b8c600be381799, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40073,1696496401119; forceNewPlan=false, retain=false 2023-10-05 09:01:26,367 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ad27d33d1643132528cf9a61aa1ef72, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35953,1696496401154; forceNewPlan=false, retain=false 2023-10-05 09:01:26,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-05 09:01:26,517 INFO [jenkins-hbase4:37915] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 09:01:26,520 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=6ad27d33d1643132528cf9a61aa1ef72, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:26,520 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=07b7de0763af186139b8c600be381799, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:26,520 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696496486520"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496486520"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496486520"}]},"ts":"1696496486520"} 2023-10-05 09:01:26,520 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696496486520"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496486520"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496486520"}]},"ts":"1696496486520"} 2023-10-05 09:01:26,521 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 6ad27d33d1643132528cf9a61aa1ef72, server=jenkins-hbase4.apache.org,35953,1696496401154}] 2023-10-05 09:01:26,522 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 07b7de0763af186139b8c600be381799, server=jenkins-hbase4.apache.org,40073,1696496401119}] 2023-10-05 09:01:26,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-05 09:01:26,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72. 2023-10-05 09:01:26,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799. 2023-10-05 09:01:26,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6ad27d33d1643132528cf9a61aa1ef72, NAME => 'testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 09:01:26,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 07b7de0763af186139b8c600be381799, NAME => 'testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 09:01:26,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72. service=AccessControlService 2023-10-05 09:01:26,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799. service=AccessControlService 2023-10-05 09:01:26,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 09:01:26,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 09:01:26,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 6ad27d33d1643132528cf9a61aa1ef72 2023-10-05 09:01:26,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 07b7de0763af186139b8c600be381799 2023-10-05 09:01:26,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:01:26,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:01:26,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6ad27d33d1643132528cf9a61aa1ef72 2023-10-05 09:01:26,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 07b7de0763af186139b8c600be381799 2023-10-05 09:01:26,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6ad27d33d1643132528cf9a61aa1ef72 2023-10-05 09:01:26,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 07b7de0763af186139b8c600be381799 2023-10-05 09:01:26,680 INFO [StoreOpener-6ad27d33d1643132528cf9a61aa1ef72-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6ad27d33d1643132528cf9a61aa1ef72 2023-10-05 09:01:26,680 INFO [StoreOpener-07b7de0763af186139b8c600be381799-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 07b7de0763af186139b8c600be381799 2023-10-05 09:01:26,682 DEBUG [StoreOpener-6ad27d33d1643132528cf9a61aa1ef72-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testEmptyExportFileSystemState/6ad27d33d1643132528cf9a61aa1ef72/cf 2023-10-05 09:01:26,682 DEBUG [StoreOpener-6ad27d33d1643132528cf9a61aa1ef72-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testEmptyExportFileSystemState/6ad27d33d1643132528cf9a61aa1ef72/cf 2023-10-05 09:01:26,682 DEBUG [StoreOpener-07b7de0763af186139b8c600be381799-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testEmptyExportFileSystemState/07b7de0763af186139b8c600be381799/cf 2023-10-05 09:01:26,682 DEBUG [StoreOpener-07b7de0763af186139b8c600be381799-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testEmptyExportFileSystemState/07b7de0763af186139b8c600be381799/cf 2023-10-05 09:01:26,682 INFO [StoreOpener-6ad27d33d1643132528cf9a61aa1ef72-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6ad27d33d1643132528cf9a61aa1ef72 columnFamilyName cf 2023-10-05 09:01:26,682 INFO [StoreOpener-07b7de0763af186139b8c600be381799-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 07b7de0763af186139b8c600be381799 columnFamilyName cf 2023-10-05 09:01:26,683 INFO [StoreOpener-6ad27d33d1643132528cf9a61aa1ef72-1] regionserver.HStore(310): Store=6ad27d33d1643132528cf9a61aa1ef72/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 09:01:26,683 INFO [StoreOpener-07b7de0763af186139b8c600be381799-1] regionserver.HStore(310): Store=07b7de0763af186139b8c600be381799/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 09:01:26,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testEmptyExportFileSystemState/6ad27d33d1643132528cf9a61aa1ef72 2023-10-05 09:01:26,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testEmptyExportFileSystemState/07b7de0763af186139b8c600be381799 2023-10-05 09:01:26,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testEmptyExportFileSystemState/6ad27d33d1643132528cf9a61aa1ef72 2023-10-05 09:01:26,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testEmptyExportFileSystemState/07b7de0763af186139b8c600be381799 2023-10-05 09:01:26,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6ad27d33d1643132528cf9a61aa1ef72 2023-10-05 09:01:26,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 07b7de0763af186139b8c600be381799 2023-10-05 09:01:26,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testEmptyExportFileSystemState/6ad27d33d1643132528cf9a61aa1ef72/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 09:01:26,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testEmptyExportFileSystemState/07b7de0763af186139b8c600be381799/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 09:01:26,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6ad27d33d1643132528cf9a61aa1ef72; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67950457, jitterRate=0.01254071295261383}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 09:01:26,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6ad27d33d1643132528cf9a61aa1ef72: 2023-10-05 09:01:26,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 07b7de0763af186139b8c600be381799; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66712222, jitterRate=-0.005910426378250122}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 09:01:26,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 07b7de0763af186139b8c600be381799: 2023-10-05 09:01:26,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799., pid=94, masterSystemTime=1696496486673 2023-10-05 09:01:26,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72., pid=93, masterSystemTime=1696496486673 2023-10-05 09:01:26,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799. 2023-10-05 09:01:26,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799. 2023-10-05 09:01:26,692 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=07b7de0763af186139b8c600be381799, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:26,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72. 2023-10-05 09:01:26,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72. 2023-10-05 09:01:26,692 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696496486692"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696496486692"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696496486692"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696496486692"}]},"ts":"1696496486692"} 2023-10-05 09:01:26,692 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=6ad27d33d1643132528cf9a61aa1ef72, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:26,693 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696496486692"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696496486692"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696496486692"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696496486692"}]},"ts":"1696496486692"} 2023-10-05 09:01:26,695 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-10-05 09:01:26,695 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 07b7de0763af186139b8c600be381799, server=jenkins-hbase4.apache.org,40073,1696496401119 in 171 msec 2023-10-05 09:01:26,695 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-10-05 09:01:26,696 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 6ad27d33d1643132528cf9a61aa1ef72, server=jenkins-hbase4.apache.org,35953,1696496401154 in 173 msec 2023-10-05 09:01:26,696 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=07b7de0763af186139b8c600be381799, ASSIGN in 331 msec 2023-10-05 09:01:26,697 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-10-05 09:01:26,697 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ad27d33d1643132528cf9a61aa1ef72, ASSIGN in 332 msec 2023-10-05 09:01:26,698 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 09:01:26,698 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496486698"}]},"ts":"1696496486698"} 2023-10-05 09:01:26,699 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-10-05 09:01:26,701 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 09:01:26,701 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-10-05 09:01:26,703 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40073] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 09:01:26,705 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:26,705 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:26,705 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:26,705 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:26,706 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 09:01:26,706 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 09:01:26,706 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 09:01:26,707 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 09:01:26,708 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 386 msec 2023-10-05 09:01:26,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-05 09:01:26,927 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-10-05 09:01:26,929 DEBUG [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-05 09:01:26,929 DEBUG [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72. 2023-10-05 09:01:26,931 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 09:01:26,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 09:01:26,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696496486942 (current time:1696496486942). 2023-10-05 09:01:26,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 09:01:26,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(139): Connect 0x6ff95698 to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:01:26,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a1dfbff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:01:26,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:01:26,953 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:01:26,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ff95698 to 127.0.0.1:63699 2023-10-05 09:01:26,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:01:26,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(139): Connect 0x223a52d7 to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:01:26,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d28d9e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:01:26,961 DEBUG [hconnection-0x72655c98-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:01:26,963 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37696, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:01:26,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:01:26,968 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:01:26,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x223a52d7 to 127.0.0.1:63699 2023-10-05 09:01:26,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:01:26,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 09:01:26,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 09:01:26,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 09:01:26,972 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot, current working dir path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 09:01:26,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 09:01:26,977 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 09:01:26,977 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696497086977 2023-10-05 09:01:26,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 09:01:26,977 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-05 09:01:26,978 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 09:01:26,978 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 09:01:26,979 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 09:01:26,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 09:01:26,980 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-10-05 09:01:26,983 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 09:01:26,983 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696497086983 2023-10-05 09:01:26,991 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:26,991 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-10-05 09:01:26,991 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:26,992 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-05 09:01:26,992 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-05 09:01:26,993 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:26,993 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:26,999 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:26,999 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:26,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:26,999 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:26,999 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:26,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:26,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:26,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:26,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:26,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:26,999 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:26,999 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,000 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,000 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 09:01:27,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-05 09:01:27,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-05 09:01:27,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-05 09:01:27,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,001 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 09:01:27,001 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 09:01:27,001 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 09:01:27,004 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,004 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,004 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 09:01:27,004 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:27,004 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 09:01:27,005 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 09:01:27,005 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 09:01:27,004 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,005 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40073,1696496401119' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 09:01:27,005 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 09:01:27,005 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:27,005 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:27,006 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 09:01:27,006 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 09:01:27,006 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 09:01:27,006 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 09:01:27,006 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41057,1696496401070' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 09:01:27,006 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35953,1696496401154' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 09:01:27,008 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,008 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:27,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:27,010 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,010 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,010 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:27,010 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,011 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:01:27,010 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:01:27,010 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:27,011 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,011 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:01:27,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:27,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:27,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40073,1696496401119' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-05 09:01:27,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c852855[Count = 1] remaining members to acquire global barrier 2023-10-05 09:01:27,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:27,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:27,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:27,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:27,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:27,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:27,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35953,1696496401154' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-05 09:01:27,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c852855[Count = 0] remaining members to acquire global barrier 2023-10-05 09:01:27,015 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-05 09:01:27,015 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,017 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,017 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,017 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,017 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 09:01:27,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,017 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,017 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 09:01:27,017 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 09:01:27,017 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 09:01:27,017 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799. 2023-10-05 09:01:27,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,017 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799. started... 2023-10-05 09:01:27,017 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 09:01:27,017 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,017 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 09:01:27,017 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 09:01:27,019 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 09:01:27,019 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72. 2023-10-05 09:01:27,019 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 09:01:27,019 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 07b7de0763af186139b8c600be381799: 2023-10-05 09:01:27,019 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41057,1696496401070' in zk 2023-10-05 09:01:27,019 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72. started... 2023-10-05 09:01:27,019 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,019 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 09:01:27,019 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6ad27d33d1643132528cf9a61aa1ef72: 2023-10-05 09:01:27,019 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 09:01:27,019 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,019 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 09:01:27,019 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 09:01:27,021 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 09:01:27,021 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:27,021 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 09:01:27,031 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72. completed. 2023-10-05 09:01:27,031 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72. 2023-10-05 09:01:27,031 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 09:01:27,031 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 09:01:27,031 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,031 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 09:01:27,032 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35953,1696496401154' in zk 2023-10-05 09:01:27,032 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799. completed. 2023-10-05 09:01:27,032 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799. 2023-10-05 09:01:27,032 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 09:01:27,032 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 09:01:27,032 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,032 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 09:01:27,032 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40073,1696496401119' in zk 2023-10-05 09:01:27,033 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 09:01:27,033 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,033 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:27,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:27,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:27,033 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 09:01:27,036 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,036 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 09:01:27,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:27,036 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:27,036 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 09:01:27,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:27,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:27,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:27,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:27,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35953,1696496401154': 2023-10-05 09:01:27,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35953,1696496401154' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-05 09:01:27,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:27,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:27,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:27,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:27,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:27,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:27,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:27,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40073,1696496401119': 2023-10-05 09:01:27,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40073,1696496401119' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-05 09:01:27,042 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-10-05 09:01:27,042 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 09:01:27,042 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 09:01:27,043 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,043 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 09:01:27,044 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,045 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:27,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:27,045 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,045 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:27,045 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,045 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:27,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:27,045 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:27,045 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:27,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:27,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:27,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:27,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:27,046 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,046 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:27,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:27,048 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:27,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,048 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:27,048 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,052 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,052 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,052 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:27,052 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:27,052 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:27,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:27,052 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:27,052 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:27,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:27,052 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:27,052 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:27,052 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:27,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:27,052 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:27,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:27,054 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-05 09:01:27,053 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:27,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:27,054 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,054 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,054 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 09:01:27,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:27,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:27,054 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:27,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:27,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:27,054 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,054 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,054 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:27,054 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,054 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 09:01:27,062 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,063 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,079 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:01:27,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 09:01:27,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-05 09:01:27,080 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 09:01:27,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,087 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-05 09:01:27,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,088 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,088 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696496486977Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696496487062 (+85 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696496487062Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1696496487062Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1696496487066 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696496487082 (+16 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696496487087 (+5 ms) 2023-10-05 09:01:27,091 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 09:01:27,092 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 113 msec 2023-10-05 09:01:27,177 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-05 09:01:27,280 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:01:27,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 09:01:27,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 09:01:27,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35953] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 09:01:27,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40073] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 09:01:27,287 DEBUG [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-05 09:01:27,287 DEBUG [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72. 2023-10-05 09:01:27,287 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 09:01:27,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 09:01:27,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696496487296 (current time:1696496487296). 2023-10-05 09:01:27,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 09:01:27,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(139): Connect 0x523eb00e to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:01:27,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7675cc1c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:01:27,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:01:27,306 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37706, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:01:27,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x523eb00e to 127.0.0.1:63699 2023-10-05 09:01:27,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:01:27,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(139): Connect 0x6668f89e to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:01:27,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41f18a9d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:01:27,314 DEBUG [hconnection-0x193cbb93-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:01:27,314 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37714, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:01:27,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:01:27,318 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49256, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:01:27,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6668f89e to 127.0.0.1:63699 2023-10-05 09:01:27,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:01:27,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 09:01:27,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 09:01:27,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 09:01:27,322 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot, current working dir path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 09:01:27,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 09:01:27,324 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 09:01:27,325 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696497087325 2023-10-05 09:01:27,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 09:01:27,325 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-05 09:01:27,326 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 09:01:27,326 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 09:01:27,327 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 09:01:27,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 09:01:27,328 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-10-05 09:01:27,329 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 09:01:27,329 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696497087329 2023-10-05 09:01:27,339 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,339 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-10-05 09:01:27,339 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:27,340 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-05 09:01:27,340 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-05 09:01:27,340 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,340 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,341 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:27,341 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:27,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:27,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:27,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:27,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:27,342 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,341 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:27,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:27,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:27,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,342 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,342 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-05 09:01:27,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,343 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,343 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 09:01:27,343 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 09:01:27,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-05 09:01:27,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-05 09:01:27,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,343 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 09:01:27,343 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 09:01:27,343 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,343 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,343 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 09:01:27,343 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 09:01:27,343 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,344 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:27,344 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 09:01:27,344 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:27,343 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:27,345 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 09:01:27,348 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 09:01:27,344 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 09:01:27,348 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35953,1696496401154' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 09:01:27,348 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 09:01:27,348 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 09:01:27,349 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 09:01:27,349 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41057,1696496401070' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 09:01:27,349 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40073,1696496401119' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 09:01:27,350 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,350 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:27,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:27,351 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,351 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,351 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,351 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,351 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:01:27,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:27,351 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,351 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:01:27,351 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,351 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:01:27,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:27,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:27,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:27,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35953,1696496401154' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-05 09:01:27,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3895fcee[Count = 1] remaining members to acquire global barrier 2023-10-05 09:01:27,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:27,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:27,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:27,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:27,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:27,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:27,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40073,1696496401119' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-05 09:01:27,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3895fcee[Count = 0] remaining members to acquire global barrier 2023-10-05 09:01:27,355 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-05 09:01:27,355 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,359 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,359 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,359 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,359 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,359 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 09:01:27,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,359 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 09:01:27,360 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 09:01:27,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,360 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,360 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 09:01:27,360 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 09:01:27,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,360 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72. 2023-10-05 09:01:27,360 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 09:01:27,360 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72. started... 2023-10-05 09:01:27,360 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41057,1696496401070' in zk 2023-10-05 09:01:27,360 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 09:01:27,360 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 09:01:27,360 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799. 2023-10-05 09:01:27,360 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 09:01:27,360 INFO [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6ad27d33d1643132528cf9a61aa1ef72 1/1 column families, dataSize=132 B heapSize=544 B 2023-10-05 09:01:27,360 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799. started... 2023-10-05 09:01:27,360 INFO [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 07b7de0763af186139b8c600be381799 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-10-05 09:01:27,361 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 09:01:27,361 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:27,361 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 09:01:27,384 INFO [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231005e8c4db6242b54c7e9bb294e811669bca to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231005e8c4db6242b54c7e9bb294e811669bca 2023-10-05 09:01:27,386 INFO [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310058f6965320923406baca3d24fc67c1088 to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310058f6965320923406baca3d24fc67c1088 2023-10-05 09:01:27,393 INFO [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testEmptyExportFileSystemState/6ad27d33d1643132528cf9a61aa1ef72/.tmp/cf/e87006d1942648a480539aa57ffe8e24 2023-10-05 09:01:27,396 INFO [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testEmptyExportFileSystemState/07b7de0763af186139b8c600be381799/.tmp/cf/92ad9c02dcd54a239be51a6fd51c4d3e 2023-10-05 09:01:27,398 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testEmptyExportFileSystemState/6ad27d33d1643132528cf9a61aa1ef72/.tmp/cf/e87006d1942648a480539aa57ffe8e24 as hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testEmptyExportFileSystemState/6ad27d33d1643132528cf9a61aa1ef72/cf/e87006d1942648a480539aa57ffe8e24 2023-10-05 09:01:27,401 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testEmptyExportFileSystemState/07b7de0763af186139b8c600be381799/.tmp/cf/92ad9c02dcd54a239be51a6fd51c4d3e as hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testEmptyExportFileSystemState/07b7de0763af186139b8c600be381799/cf/92ad9c02dcd54a239be51a6fd51c4d3e 2023-10-05 09:01:27,403 INFO [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testEmptyExportFileSystemState/6ad27d33d1643132528cf9a61aa1ef72/cf/e87006d1942648a480539aa57ffe8e24, entries=2, sequenceid=6, filesize=5.2 K 2023-10-05 09:01:27,404 INFO [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 6ad27d33d1643132528cf9a61aa1ef72 in 44ms, sequenceid=6, compaction requested=false 2023-10-05 09:01:27,406 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6ad27d33d1643132528cf9a61aa1ef72: 2023-10-05 09:01:27,406 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,406 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 09:01:27,406 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testEmptyExportFileSystemState/6ad27d33d1643132528cf9a61aa1ef72/cf/e87006d1942648a480539aa57ffe8e24] hfiles 2023-10-05 09:01:27,406 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testEmptyExportFileSystemState/6ad27d33d1643132528cf9a61aa1ef72/cf/e87006d1942648a480539aa57ffe8e24 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,407 INFO [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testEmptyExportFileSystemState/07b7de0763af186139b8c600be381799/cf/92ad9c02dcd54a239be51a6fd51c4d3e, entries=48, sequenceid=6, filesize=13.2 K 2023-10-05 09:01:27,408 INFO [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 07b7de0763af186139b8c600be381799 in 48ms, sequenceid=6, compaction requested=false 2023-10-05 09:01:27,408 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 07b7de0763af186139b8c600be381799: 2023-10-05 09:01:27,408 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,410 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 09:01:27,410 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testEmptyExportFileSystemState/07b7de0763af186139b8c600be381799/cf/92ad9c02dcd54a239be51a6fd51c4d3e] hfiles 2023-10-05 09:01:27,410 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testEmptyExportFileSystemState/07b7de0763af186139b8c600be381799/cf/92ad9c02dcd54a239be51a6fd51c4d3e for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,422 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72. completed. 2023-10-05 09:01:27,422 DEBUG [rs(jenkins-hbase4.apache.org,35953,1696496401154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72. 2023-10-05 09:01:27,422 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 09:01:27,422 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 09:01:27,422 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,422 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 09:01:27,422 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35953,1696496401154' in zk 2023-10-05 09:01:27,424 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 09:01:27,424 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,424 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:27,424 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 09:01:27,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:27,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:27,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:27,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:27,426 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:01:27,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:27,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 09:01:27,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-05 09:01:27,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,428 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 09:01:27,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:27,428 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799. completed. 2023-10-05 09:01:27,428 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799. 2023-10-05 09:01:27,428 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 09:01:27,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,428 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 09:01:27,429 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,429 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 09:01:27,429 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40073,1696496401119' in zk 2023-10-05 09:01:27,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:27,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,430 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,430 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 09:01:27,430 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:27,430 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 09:01:27,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35953,1696496401154': 2023-10-05 09:01:27,431 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35953,1696496401154' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-05 09:01:27,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:27,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:27,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:27,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:27,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:27,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:27,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:27,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40073,1696496401119': 2023-10-05 09:01:27,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40073,1696496401119' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-05 09:01:27,435 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-10-05 09:01:27,435 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 09:01:27,435 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 09:01:27,435 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,435 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 09:01:27,437 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,437 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,437 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:27,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,437 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:27,437 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,437 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:27,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:27,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,437 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:27,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:27,438 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:27,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:27,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:27,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:27,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:27,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:27,438 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:27,439 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:27,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:27,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,440 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:27,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:27,440 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,440 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:27,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,443 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,443 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:27,443 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:27,443 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:27,443 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:27,443 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,443 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:27,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:27,443 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,443 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:27,444 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-05 09:01:27,443 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:27,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:27,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 09:01:27,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:27,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:27,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:27,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:27,443 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,445 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:27,445 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,445 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:27,445 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,445 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:27,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:27,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:27,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:27,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:27,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:27,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:27,445 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:27,445 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,446 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310058f6965320923406baca3d24fc67c1088, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231005e8c4db6242b54c7e9bb294e811669bca] mob files 2023-10-05 09:01:27,446 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,446 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310058f6965320923406baca3d24fc67c1088 2023-10-05 09:01:27,446 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231005e8c4db6242b54c7e9bb294e811669bca 2023-10-05 09:01:27,452 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,452 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,467 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,468 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-05 09:01:27,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,468 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696496487325Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696496487452 (+127 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1696496487452Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1696496487452Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1696496487455 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1696496487461 (+6 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696496487468 (+7 ms) 2023-10-05 09:01:27,473 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 09:01:27,474 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 147 msec 2023-10-05 09:01:27,628 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:01:27,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 09:01:27,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 09:01:27,629 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496487629 2023-10-05 09:01:27,629 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45983, tgtDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496487629, rawTgtDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496487629, srcFsUri=hdfs://localhost:45983, srcDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c 2023-10-05 09:01:27,651 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45983, inputRoot=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c 2023-10-05 09:01:27,651 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1211254140_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496487629, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496487629/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,651 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45983, inputRoot=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c, snapshotDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-10-05 09:01:27,656 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496487629/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:27,676 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:27,677 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:27,677 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:27,677 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:27,678 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:27,678 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:27,678 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:27,744 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/hadoop-2154788576690975850.jar 2023-10-05 09:01:27,745 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:27,745 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:27,745 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:27,746 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:27,746 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:27,746 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:27,747 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 09:01:27,747 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 09:01:27,747 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 09:01:27,748 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 09:01:27,748 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 09:01:27,748 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 09:01:27,749 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 09:01:27,749 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 09:01:27,749 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 09:01:27,750 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 09:01:27,750 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:01:27,750 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:01:27,751 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 09:01:27,751 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:01:27,751 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:01:27,751 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 09:01:27,752 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 09:01:28,085 WARN [Listener at jenkins-hbase4.apache.org/41667] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 09:01:28,087 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-10-05 09:01:30,405 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 09:01:30,405 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 09:01:30,407 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0005_000001 (auth:SIMPLE) 2023-10-05 09:01:31,169 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0006_000001 (auth:SIMPLE) 2023-10-05 09:01:31,172 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 09:01:34,960 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0006_000001 (auth:SIMPLE) 2023-10-05 09:01:37,427 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 09:01:37,428 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 09:01:37,432 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:37,432 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 09:01:37,433 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 09:01:37,433 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_795266163_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:37,434 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-05 09:01:37,434 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-05 09:01:37,434 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_795266163_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496487629/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496487629/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:37,434 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496487629/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-05 09:01:37,434 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496487629/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-05 09:01:37,439 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-10-05 09:01:37,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-10-05 09:01:37,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 09:01:37,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-05 09:01:37,443 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496497443"}]},"ts":"1696496497443"} 2023-10-05 09:01:37,444 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-10-05 09:01:37,446 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-10-05 09:01:37,447 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ad27d33d1643132528cf9a61aa1ef72, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=07b7de0763af186139b8c600be381799, UNASSIGN}] 2023-10-05 09:01:37,449 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ad27d33d1643132528cf9a61aa1ef72, UNASSIGN 2023-10-05 09:01:37,449 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=07b7de0763af186139b8c600be381799, UNASSIGN 2023-10-05 09:01:37,449 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=6ad27d33d1643132528cf9a61aa1ef72, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:37,449 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=07b7de0763af186139b8c600be381799, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:37,450 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696496497449"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496497449"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496497449"}]},"ts":"1696496497449"} 2023-10-05 09:01:37,450 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696496497449"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496497449"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496497449"}]},"ts":"1696496497449"} 2023-10-05 09:01:37,451 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 6ad27d33d1643132528cf9a61aa1ef72, server=jenkins-hbase4.apache.org,35953,1696496401154}] 2023-10-05 09:01:37,452 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 07b7de0763af186139b8c600be381799, server=jenkins-hbase4.apache.org,40073,1696496401119}] 2023-10-05 09:01:37,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-05 09:01:37,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6ad27d33d1643132528cf9a61aa1ef72 2023-10-05 09:01:37,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6ad27d33d1643132528cf9a61aa1ef72, disabling compactions & flushes 2023-10-05 09:01:37,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72. 2023-10-05 09:01:37,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72. 2023-10-05 09:01:37,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72. after waiting 0 ms 2023-10-05 09:01:37,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72. 2023-10-05 09:01:37,607 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 07b7de0763af186139b8c600be381799 2023-10-05 09:01:37,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 07b7de0763af186139b8c600be381799, disabling compactions & flushes 2023-10-05 09:01:37,607 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799. 2023-10-05 09:01:37,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799. 2023-10-05 09:01:37,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799. after waiting 0 ms 2023-10-05 09:01:37,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799. 2023-10-05 09:01:37,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testEmptyExportFileSystemState/6ad27d33d1643132528cf9a61aa1ef72/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 09:01:37,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testEmptyExportFileSystemState/07b7de0763af186139b8c600be381799/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 09:01:37,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 09:01:37,613 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72. 2023-10-05 09:01:37,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6ad27d33d1643132528cf9a61aa1ef72: 2023-10-05 09:01:37,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 09:01:37,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799. 2023-10-05 09:01:37,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 07b7de0763af186139b8c600be381799: 2023-10-05 09:01:37,615 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6ad27d33d1643132528cf9a61aa1ef72 2023-10-05 09:01:37,616 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=6ad27d33d1643132528cf9a61aa1ef72, regionState=CLOSED 2023-10-05 09:01:37,616 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696496497615"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496497615"}]},"ts":"1696496497615"} 2023-10-05 09:01:37,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 07b7de0763af186139b8c600be381799 2023-10-05 09:01:37,616 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=07b7de0763af186139b8c600be381799, regionState=CLOSED 2023-10-05 09:01:37,617 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696496497616"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496497616"}]},"ts":"1696496497616"} 2023-10-05 09:01:37,619 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-10-05 09:01:37,619 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 6ad27d33d1643132528cf9a61aa1ef72, server=jenkins-hbase4.apache.org,35953,1696496401154 in 166 msec 2023-10-05 09:01:37,619 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-10-05 09:01:37,619 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 07b7de0763af186139b8c600be381799, server=jenkins-hbase4.apache.org,40073,1696496401119 in 167 msec 2023-10-05 09:01:37,620 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ad27d33d1643132528cf9a61aa1ef72, UNASSIGN in 172 msec 2023-10-05 09:01:37,621 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-10-05 09:01:37,621 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=07b7de0763af186139b8c600be381799, UNASSIGN in 172 msec 2023-10-05 09:01:37,621 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496497621"}]},"ts":"1696496497621"} 2023-10-05 09:01:37,622 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-10-05 09:01:37,624 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-10-05 09:01:37,625 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 186 msec 2023-10-05 09:01:37,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-05 09:01:37,745 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-10-05 09:01:37,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-10-05 09:01:37,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 09:01:37,748 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 09:01:37,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-10-05 09:01:37,749 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 09:01:37,750 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40073] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-10-05 09:01:37,753 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ad27d33d1643132528cf9a61aa1ef72 2023-10-05 09:01:37,753 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testEmptyExportFileSystemState/07b7de0763af186139b8c600be381799 2023-10-05 09:01:37,753 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 09:01:37,753 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 09:01:37,753 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 09:01:37,753 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 09:01:37,754 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-05 09:01:37,754 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-05 09:01:37,754 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-05 09:01:37,754 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-05 09:01:37,754 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 09:01:37,754 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 09:01:37,755 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 09:01:37,755 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:37,754 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:37,754 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 09:01:37,755 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:37,755 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ad27d33d1643132528cf9a61aa1ef72/cf, FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ad27d33d1643132528cf9a61aa1ef72/recovered.edits] 2023-10-05 09:01:37,755 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:37,755 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testEmptyExportFileSystemState/07b7de0763af186139b8c600be381799/cf, FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testEmptyExportFileSystemState/07b7de0763af186139b8c600be381799/recovered.edits] 2023-10-05 09:01:37,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-05 09:01:37,760 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ad27d33d1643132528cf9a61aa1ef72/cf/e87006d1942648a480539aa57ffe8e24 to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testEmptyExportFileSystemState/6ad27d33d1643132528cf9a61aa1ef72/cf/e87006d1942648a480539aa57ffe8e24 2023-10-05 09:01:37,760 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testEmptyExportFileSystemState/07b7de0763af186139b8c600be381799/cf/92ad9c02dcd54a239be51a6fd51c4d3e to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testEmptyExportFileSystemState/07b7de0763af186139b8c600be381799/cf/92ad9c02dcd54a239be51a6fd51c4d3e 2023-10-05 09:01:37,763 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ad27d33d1643132528cf9a61aa1ef72/recovered.edits/9.seqid to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testEmptyExportFileSystemState/6ad27d33d1643132528cf9a61aa1ef72/recovered.edits/9.seqid 2023-10-05 09:01:37,763 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testEmptyExportFileSystemState/07b7de0763af186139b8c600be381799/recovered.edits/9.seqid to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testEmptyExportFileSystemState/07b7de0763af186139b8c600be381799/recovered.edits/9.seqid 2023-10-05 09:01:37,764 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ad27d33d1643132528cf9a61aa1ef72 2023-10-05 09:01:37,764 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testEmptyExportFileSystemState/07b7de0763af186139b8c600be381799 2023-10-05 09:01:37,764 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-05 09:01:37,765 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-05 09:01:37,766 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-10-05 09:01:37,769 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310058f6965320923406baca3d24fc67c1088 to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310058f6965320923406baca3d24fc67c1088 2023-10-05 09:01:37,771 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231005e8c4db6242b54c7e9bb294e811669bca to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231005e8c4db6242b54c7e9bb294e811669bca 2023-10-05 09:01:37,771 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-05 09:01:37,774 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 09:01:37,776 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-10-05 09:01:37,778 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-10-05 09:01:37,779 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 09:01:37,779 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-10-05 09:01:37,779 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696496497779"}]},"ts":"9223372036854775807"} 2023-10-05 09:01:37,779 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696496497779"}]},"ts":"9223372036854775807"} 2023-10-05 09:01:37,781 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 09:01:37,781 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6ad27d33d1643132528cf9a61aa1ef72, NAME => 'testtb-testEmptyExportFileSystemState,,1696496486320.6ad27d33d1643132528cf9a61aa1ef72.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 07b7de0763af186139b8c600be381799, NAME => 'testtb-testEmptyExportFileSystemState,1,1696496486320.07b7de0763af186139b8c600be381799.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 09:01:37,781 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-10-05 09:01:37,781 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696496497781"}]},"ts":"9223372036854775807"} 2023-10-05 09:01:37,783 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-10-05 09:01:37,785 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 09:01:37,786 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 40 msec 2023-10-05 09:01:37,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-05 09:01:37,857 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-10-05 09:01:37,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-10-05 09:01:37,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:37,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-10-05 09:01:37,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-10-05 09:01:37,893 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 761) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_795266163_17 at /127.0.0.1:38848 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1032508212_1 at /127.0.0.1:35274 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5555080-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:33371 from appattempt_1696496407751_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:41187 from appattempt_1696496407751_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x5555080-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4493 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x5555080-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:32873 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_795266163_17 at /127.0.0.1:33736 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1032508212_1 at /127.0.0.1:38840 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5555080-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_795266163_17 at /127.0.0.1:34182 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=926 (was 913) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=164 (was 184), ProcessCount=167 (was 167), AvailableMemoryMB=5707 (was 5730) 2023-10-05 09:01:37,893 WARN [Listener at jenkins-hbase4.apache.org/41667] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-05 09:01:37,912 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=926, MaxFileDescriptor=60000, SystemLoadAverage=164, ProcessCount=167, AvailableMemoryMB=5706 2023-10-05 09:01:37,912 WARN [Listener at jenkins-hbase4.apache.org/41667] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-05 09:01:37,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 09:01:37,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:37,917 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 09:01:37,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-10-05 09:01:37,918 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 09:01:37,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-05 09:01:37,920 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d98b4eec76d5347a857777e343c5c858 2023-10-05 09:01:37,920 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1952dd96cda55729ed40887034685d07 2023-10-05 09:01:37,921 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d98b4eec76d5347a857777e343c5c858 empty. 2023-10-05 09:01:37,921 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1952dd96cda55729ed40887034685d07 empty. 2023-10-05 09:01:37,921 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d98b4eec76d5347a857777e343c5c858 2023-10-05 09:01:37,921 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1952dd96cda55729ed40887034685d07 2023-10-05 09:01:37,921 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-05 09:01:37,930 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-10-05 09:01:37,932 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => d98b4eec76d5347a857777e343c5c858, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp 2023-10-05 09:01:37,932 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1952dd96cda55729ed40887034685d07, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp 2023-10-05 09:01:37,941 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:01:37,941 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing d98b4eec76d5347a857777e343c5c858, disabling compactions & flushes 2023-10-05 09:01:37,941 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858. 2023-10-05 09:01:37,941 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858. 2023-10-05 09:01:37,941 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858. after waiting 0 ms 2023-10-05 09:01:37,941 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858. 2023-10-05 09:01:37,941 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858. 2023-10-05 09:01:37,941 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for d98b4eec76d5347a857777e343c5c858: 2023-10-05 09:01:37,945 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:01:37,945 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 1952dd96cda55729ed40887034685d07, disabling compactions & flushes 2023-10-05 09:01:37,945 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07. 2023-10-05 09:01:37,945 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07. 2023-10-05 09:01:37,945 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07. after waiting 0 ms 2023-10-05 09:01:37,945 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07. 2023-10-05 09:01:37,945 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07. 2023-10-05 09:01:37,945 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 1952dd96cda55729ed40887034685d07: 2023-10-05 09:01:37,947 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 09:01:37,949 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696496497948"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496497948"}]},"ts":"1696496497948"} 2023-10-05 09:01:37,949 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696496497948"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496497948"}]},"ts":"1696496497948"} 2023-10-05 09:01:37,951 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 09:01:37,951 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 09:01:37,951 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496497951"}]},"ts":"1696496497951"} 2023-10-05 09:01:37,953 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-10-05 09:01:37,957 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 09:01:37,958 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 09:01:37,958 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 09:01:37,958 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 09:01:37,958 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 09:01:37,958 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d98b4eec76d5347a857777e343c5c858, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1952dd96cda55729ed40887034685d07, ASSIGN}] 2023-10-05 09:01:37,961 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1952dd96cda55729ed40887034685d07, ASSIGN 2023-10-05 09:01:37,961 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d98b4eec76d5347a857777e343c5c858, ASSIGN 2023-10-05 09:01:37,962 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1952dd96cda55729ed40887034685d07, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41057,1696496401070; forceNewPlan=false, retain=false 2023-10-05 09:01:37,962 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d98b4eec76d5347a857777e343c5c858, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40073,1696496401119; forceNewPlan=false, retain=false 2023-10-05 09:01:38,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-05 09:01:38,112 INFO [jenkins-hbase4:37915] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 09:01:38,115 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=1952dd96cda55729ed40887034685d07, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,115 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=d98b4eec76d5347a857777e343c5c858, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,115 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696496498115"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496498115"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496498115"}]},"ts":"1696496498115"} 2023-10-05 09:01:38,115 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696496498115"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496498115"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496498115"}]},"ts":"1696496498115"} 2023-10-05 09:01:38,117 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure d98b4eec76d5347a857777e343c5c858, server=jenkins-hbase4.apache.org,40073,1696496401119}] 2023-10-05 09:01:38,117 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 1952dd96cda55729ed40887034685d07, server=jenkins-hbase4.apache.org,41057,1696496401070}] 2023-10-05 09:01:38,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-05 09:01:38,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858. 2023-10-05 09:01:38,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d98b4eec76d5347a857777e343c5c858, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 09:01:38,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07. 2023-10-05 09:01:38,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1952dd96cda55729ed40887034685d07, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 09:01:38,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858. service=AccessControlService 2023-10-05 09:01:38,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07. service=AccessControlService 2023-10-05 09:01:38,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 09:01:38,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 09:01:38,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 1952dd96cda55729ed40887034685d07 2023-10-05 09:01:38,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp d98b4eec76d5347a857777e343c5c858 2023-10-05 09:01:38,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:01:38,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 09:01:38,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1952dd96cda55729ed40887034685d07 2023-10-05 09:01:38,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d98b4eec76d5347a857777e343c5c858 2023-10-05 09:01:38,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1952dd96cda55729ed40887034685d07 2023-10-05 09:01:38,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d98b4eec76d5347a857777e343c5c858 2023-10-05 09:01:38,274 INFO [StoreOpener-d98b4eec76d5347a857777e343c5c858-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d98b4eec76d5347a857777e343c5c858 2023-10-05 09:01:38,274 INFO [StoreOpener-1952dd96cda55729ed40887034685d07-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1952dd96cda55729ed40887034685d07 2023-10-05 09:01:38,275 DEBUG [StoreOpener-1952dd96cda55729ed40887034685d07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithSkipTmp/1952dd96cda55729ed40887034685d07/cf 2023-10-05 09:01:38,275 DEBUG [StoreOpener-1952dd96cda55729ed40887034685d07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithSkipTmp/1952dd96cda55729ed40887034685d07/cf 2023-10-05 09:01:38,275 DEBUG [StoreOpener-d98b4eec76d5347a857777e343c5c858-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithSkipTmp/d98b4eec76d5347a857777e343c5c858/cf 2023-10-05 09:01:38,275 DEBUG [StoreOpener-d98b4eec76d5347a857777e343c5c858-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithSkipTmp/d98b4eec76d5347a857777e343c5c858/cf 2023-10-05 09:01:38,276 INFO [StoreOpener-1952dd96cda55729ed40887034685d07-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1952dd96cda55729ed40887034685d07 columnFamilyName cf 2023-10-05 09:01:38,276 INFO [StoreOpener-d98b4eec76d5347a857777e343c5c858-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d98b4eec76d5347a857777e343c5c858 columnFamilyName cf 2023-10-05 09:01:38,277 INFO [StoreOpener-1952dd96cda55729ed40887034685d07-1] regionserver.HStore(310): Store=1952dd96cda55729ed40887034685d07/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 09:01:38,277 INFO [StoreOpener-d98b4eec76d5347a857777e343c5c858-1] regionserver.HStore(310): Store=d98b4eec76d5347a857777e343c5c858/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 09:01:38,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithSkipTmp/1952dd96cda55729ed40887034685d07 2023-10-05 09:01:38,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithSkipTmp/d98b4eec76d5347a857777e343c5c858 2023-10-05 09:01:38,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithSkipTmp/1952dd96cda55729ed40887034685d07 2023-10-05 09:01:38,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithSkipTmp/d98b4eec76d5347a857777e343c5c858 2023-10-05 09:01:38,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1952dd96cda55729ed40887034685d07 2023-10-05 09:01:38,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d98b4eec76d5347a857777e343c5c858 2023-10-05 09:01:38,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithSkipTmp/d98b4eec76d5347a857777e343c5c858/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 09:01:38,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithSkipTmp/1952dd96cda55729ed40887034685d07/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 09:01:38,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d98b4eec76d5347a857777e343c5c858; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74423238, jitterRate=0.10899266600608826}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 09:01:38,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d98b4eec76d5347a857777e343c5c858: 2023-10-05 09:01:38,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1952dd96cda55729ed40887034685d07; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68081049, jitterRate=0.014486685395240784}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 09:01:38,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1952dd96cda55729ed40887034685d07: 2023-10-05 09:01:38,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858., pid=108, masterSystemTime=1696496498268 2023-10-05 09:01:38,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07., pid=109, masterSystemTime=1696496498269 2023-10-05 09:01:38,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858. 2023-10-05 09:01:38,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858. 2023-10-05 09:01:38,286 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=d98b4eec76d5347a857777e343c5c858, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07. 2023-10-05 09:01:38,286 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696496498286"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696496498286"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696496498286"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696496498286"}]},"ts":"1696496498286"} 2023-10-05 09:01:38,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07. 2023-10-05 09:01:38,287 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=1952dd96cda55729ed40887034685d07, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,287 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696496498287"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696496498287"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696496498287"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696496498287"}]},"ts":"1696496498287"} 2023-10-05 09:01:38,289 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-10-05 09:01:38,289 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure d98b4eec76d5347a857777e343c5c858, server=jenkins-hbase4.apache.org,40073,1696496401119 in 171 msec 2023-10-05 09:01:38,290 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-10-05 09:01:38,290 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 1952dd96cda55729ed40887034685d07, server=jenkins-hbase4.apache.org,41057,1696496401070 in 171 msec 2023-10-05 09:01:38,290 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d98b4eec76d5347a857777e343c5c858, ASSIGN in 331 msec 2023-10-05 09:01:38,291 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-10-05 09:01:38,291 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1952dd96cda55729ed40887034685d07, ASSIGN in 332 msec 2023-10-05 09:01:38,291 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 09:01:38,292 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496498291"}]},"ts":"1696496498291"} 2023-10-05 09:01:38,293 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-10-05 09:01:38,295 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 09:01:38,295 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-10-05 09:01:38,296 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40073] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-05 09:01:38,297 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:38,297 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:38,297 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:38,298 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:38,300 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-05 09:01:38,300 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-05 09:01:38,300 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-05 09:01:38,300 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-05 09:01:38,301 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 386 msec 2023-10-05 09:01:38,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-05 09:01:38,522 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-10-05 09:01:38,524 DEBUG [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,524 DEBUG [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858. 2023-10-05 09:01:38,526 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 09:01:38,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 09:01:38,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696496498535 (current time:1696496498535). 2023-10-05 09:01:38,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 09:01:38,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(139): Connect 0x373c6121 to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:01:38,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55fd1bde, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:01:38,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:01:38,545 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33726, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:01:38,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x373c6121 to 127.0.0.1:63699 2023-10-05 09:01:38,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:01:38,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(139): Connect 0x7dc5d73d to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:01:38,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29a484cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:01:38,553 DEBUG [hconnection-0x14ba49cc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:01:38,555 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33736, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:01:38,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:01:38,561 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46188, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:01:38,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7dc5d73d to 127.0.0.1:63699 2023-10-05 09:01:38,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:01:38,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-05 09:01:38,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 09:01:38,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 09:01:38,565 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot, current working dir path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 09:01:38,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 09:01:38,567 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 09:01:38,568 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696497098568 2023-10-05 09:01:38,568 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 09:01:38,569 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 09:01:38,569 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 09:01:38,570 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 09:01:38,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 09:01:38,571 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-10-05 09:01:38,571 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 09:01:38,572 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696497098572 2023-10-05 09:01:38,582 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,582 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-05 09:01:38,582 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:38,583 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-05 09:01:38,583 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-05 09:01:38,583 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,583 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,584 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:38,584 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:38,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:38,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:38,584 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:38,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:38,584 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:38,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:38,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:38,585 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,585 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,585 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,585 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,585 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,586 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 09:01:38,586 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-05 09:01:38,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-05 09:01:38,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,586 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 09:01:38,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-05 09:01:38,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,586 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 09:01:38,586 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 09:01:38,586 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,586 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,586 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,586 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 09:01:38,586 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 09:01:38,587 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:38,586 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 09:01:38,587 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 09:01:38,587 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 09:01:38,586 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:38,587 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35953,1696496401154' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 09:01:38,587 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:38,588 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 09:01:38,589 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 09:01:38,589 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 09:01:38,589 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40073,1696496401119' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 09:01:38,589 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 09:01:38,589 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41057,1696496401070' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 09:01:38,599 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,600 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,600 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,600 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,600 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:01:38,600 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,600 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,600 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:01:38,600 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:38,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:38,600 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,600 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:01:38,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:38,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:38,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:38,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:38,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40073,1696496401119' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-05 09:01:38,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2608b42f[Count = 1] remaining members to acquire global barrier 2023-10-05 09:01:38,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:38,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:38,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:38,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:38,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:38,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:38,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41057,1696496401070' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-05 09:01:38,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2608b42f[Count = 0] remaining members to acquire global barrier 2023-10-05 09:01:38,604 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-05 09:01:38,604 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,605 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,605 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,605 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,605 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,605 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 09:01:38,605 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 09:01:38,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,605 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35953,1696496401154' in zk 2023-10-05 09:01:38,605 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 09:01:38,605 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,605 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 09:01:38,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,606 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 09:01:38,606 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 09:01:38,606 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 09:01:38,606 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858. 2023-10-05 09:01:38,606 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858. started... 2023-10-05 09:01:38,606 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 09:01:38,606 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07. 2023-10-05 09:01:38,606 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 09:01:38,606 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d98b4eec76d5347a857777e343c5c858: 2023-10-05 09:01:38,606 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07. started... 2023-10-05 09:01:38,606 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,607 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1952dd96cda55729ed40887034685d07: 2023-10-05 09:01:38,607 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 09:01:38,607 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 09:01:38,607 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,607 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 09:01:38,607 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:38,607 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 09:01:38,608 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 09:01:38,608 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 09:01:38,621 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858. completed. 2023-10-05 09:01:38,621 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858. 2023-10-05 09:01:38,621 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 09:01:38,621 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 09:01:38,621 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,621 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 09:01:38,621 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40073,1696496401119' in zk 2023-10-05 09:01:38,622 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07. completed. 2023-10-05 09:01:38,622 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07. 2023-10-05 09:01:38,622 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 09:01:38,622 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 09:01:38,622 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,622 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 09:01:38,622 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41057,1696496401070' in zk 2023-10-05 09:01:38,623 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 09:01:38,623 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,624 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:38,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:38,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:38,624 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 09:01:38,625 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,625 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 09:01:38,626 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:38,626 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 09:01:38,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:38,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:38,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:38,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:38,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:38,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40073,1696496401119': 2023-10-05 09:01:38,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40073,1696496401119' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-05 09:01:38,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:38,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:38,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:38,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:38,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:38,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:38,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:38,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41057,1696496401070': 2023-10-05 09:01:38,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41057,1696496401070' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-05 09:01:38,633 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-05 09:01:38,633 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 09:01:38,633 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 09:01:38,633 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,633 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 09:01:38,634 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,634 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:38,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:38,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,634 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:38,634 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,634 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,634 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:38,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:38,634 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:38,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,635 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:38,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:38,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:38,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:38,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:38,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:38,635 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:38,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:38,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,636 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:38,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:38,637 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,638 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:38,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,638 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:38,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,640 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,640 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,640 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:38,640 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,640 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,640 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:38,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:38,640 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:38,640 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:38,641 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:38,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:38,641 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,641 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:38,641 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:38,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:38,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,640 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 09:01:38,640 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:38,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:38,641 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,641 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:38,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:38,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:38,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:38,641 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:38,641 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,643 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,643 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:38,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:38,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:38,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 09:01:38,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:38,653 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,654 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,669 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-05 09:01:38,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,669 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:01:38,669 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696496498568Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696496498653 (+85 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696496498653Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696496498654 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696496498656 (+2 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696496498663 (+7 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696496498669 (+6 ms) 2023-10-05 09:01:38,672 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 09:01:38,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-05 09:01:38,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 09:01:38,674 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 104 msec 2023-10-05 09:01:38,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40073] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 09:01:38,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41057] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 09:01:38,679 DEBUG [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,679 DEBUG [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858. 2023-10-05 09:01:38,679 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 09:01:38,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 09:01:38,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696496498688 (current time:1696496498688). 2023-10-05 09:01:38,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 09:01:38,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(139): Connect 0x14c7ee84 to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:01:38,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6529bb66, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:01:38,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:01:38,697 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33746, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:01:38,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14c7ee84 to 127.0.0.1:63699 2023-10-05 09:01:38,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:01:38,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(139): Connect 0x35aed881 to 127.0.0.1:63699 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 09:01:38,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e36b37e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 09:01:38,705 DEBUG [hconnection-0x366cd955-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:01:38,712 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33756, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:01:38,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 09:01:38,718 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46192, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 09:01:38,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35aed881 to 127.0.0.1:63699 2023-10-05 09:01:38,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:01:38,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-05 09:01:38,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 09:01:38,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 09:01:38,722 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot, current working dir path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 09:01:38,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 09:01:38,724 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 09:01:38,725 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696497098725 2023-10-05 09:01:38,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 09:01:38,725 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,726 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 09:01:38,726 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 09:01:38,727 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 09:01:38,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 09:01:38,728 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-10-05 09:01:38,729 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 09:01:38,729 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696497098729 2023-10-05 09:01:38,737 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,737 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-05 09:01:38,737 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:38,739 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-05 09:01:38,739 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-05 09:01:38,739 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,739 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,741 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:38,741 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,741 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:38,741 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:38,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:38,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:38,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:38,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:38,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:38,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:38,742 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,742 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,742 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,743 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 09:01:38,743 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-05 09:01:38,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-05 09:01:38,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-05 09:01:38,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,743 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 09:01:38,743 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 09:01:38,743 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 09:01:38,743 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,743 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,743 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,743 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 09:01:38,743 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 09:01:38,743 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 09:01:38,743 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:38,743 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:38,743 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 09:01:38,745 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 09:01:38,746 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 09:01:38,746 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 09:01:38,746 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35953,1696496401154' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 09:01:38,744 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 09:01:38,746 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 09:01:38,746 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41057,1696496401070' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 09:01:38,746 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 09:01:38,746 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40073,1696496401119' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 09:01:38,747 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,747 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,748 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:38,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:38,749 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,749 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,749 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,749 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,749 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:01:38,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:38,749 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:01:38,749 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,749 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 09:01:38,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:38,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:38,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:38,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41057,1696496401070' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-05 09:01:38,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ffc0ee4[Count = 1] remaining members to acquire global barrier 2023-10-05 09:01:38,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:38,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:38,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:38,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:38,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:38,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:38,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40073,1696496401119' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-05 09:01:38,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ffc0ee4[Count = 0] remaining members to acquire global barrier 2023-10-05 09:01:38,752 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-05 09:01:38,752 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,757 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,757 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,757 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,757 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 09:01:38,757 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,757 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 09:01:38,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,757 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 09:01:38,757 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,757 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 09:01:38,758 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 09:01:38,757 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 09:01:38,758 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858. 2023-10-05 09:01:38,757 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 09:01:38,758 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858. started... 2023-10-05 09:01:38,757 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35953,1696496401154' in zk 2023-10-05 09:01:38,758 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 09:01:38,758 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 09:01:38,758 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07. 2023-10-05 09:01:38,758 INFO [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d98b4eec76d5347a857777e343c5c858 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-05 09:01:38,758 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07. started... 2023-10-05 09:01:38,758 INFO [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1952dd96cda55729ed40887034685d07 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-05 09:01:38,759 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 09:01:38,759 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:38,759 DEBUG [member: 'jenkins-hbase4.apache.org,35953,1696496401154' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 09:01:38,785 INFO [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310054dc12bc3b27041869e6b9b373d657184 to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310054dc12bc3b27041869e6b9b373d657184 2023-10-05 09:01:38,785 INFO [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023100546349ccfbb9b48af9b4ba1a20168ca15 to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023100546349ccfbb9b48af9b4ba1a20168ca15 2023-10-05 09:01:38,799 INFO [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithSkipTmp/d98b4eec76d5347a857777e343c5c858/.tmp/cf/37053f054ab149f1884ab3f2542ce603 2023-10-05 09:01:38,799 INFO [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithSkipTmp/1952dd96cda55729ed40887034685d07/.tmp/cf/ca3800188e73478f9983b81fe0eb4f80 2023-10-05 09:01:38,804 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithSkipTmp/1952dd96cda55729ed40887034685d07/.tmp/cf/ca3800188e73478f9983b81fe0eb4f80 as hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithSkipTmp/1952dd96cda55729ed40887034685d07/cf/ca3800188e73478f9983b81fe0eb4f80 2023-10-05 09:01:38,804 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithSkipTmp/d98b4eec76d5347a857777e343c5c858/.tmp/cf/37053f054ab149f1884ab3f2542ce603 as hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithSkipTmp/d98b4eec76d5347a857777e343c5c858/cf/37053f054ab149f1884ab3f2542ce603 2023-10-05 09:01:38,808 INFO [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithSkipTmp/1952dd96cda55729ed40887034685d07/cf/ca3800188e73478f9983b81fe0eb4f80, entries=47, sequenceid=6, filesize=13.3 K 2023-10-05 09:01:38,809 INFO [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithSkipTmp/d98b4eec76d5347a857777e343c5c858/cf/37053f054ab149f1884ab3f2542ce603, entries=3, sequenceid=6, filesize=5.4 K 2023-10-05 09:01:38,809 INFO [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 1952dd96cda55729ed40887034685d07 in 51ms, sequenceid=6, compaction requested=false 2023-10-05 09:01:38,809 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-05 09:01:38,809 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1952dd96cda55729ed40887034685d07: 2023-10-05 09:01:38,809 INFO [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for d98b4eec76d5347a857777e343c5c858 in 51ms, sequenceid=6, compaction requested=false 2023-10-05 09:01:38,810 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,811 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d98b4eec76d5347a857777e343c5c858: 2023-10-05 09:01:38,811 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 09:01:38,811 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithSkipTmp/1952dd96cda55729ed40887034685d07/cf/ca3800188e73478f9983b81fe0eb4f80] hfiles 2023-10-05 09:01:38,811 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithSkipTmp/1952dd96cda55729ed40887034685d07/cf/ca3800188e73478f9983b81fe0eb4f80 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,811 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,811 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 09:01:38,811 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithSkipTmp/d98b4eec76d5347a857777e343c5c858/cf/37053f054ab149f1884ab3f2542ce603] hfiles 2023-10-05 09:01:38,811 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithSkipTmp/d98b4eec76d5347a857777e343c5c858/cf/37053f054ab149f1884ab3f2542ce603 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,818 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07. completed. 2023-10-05 09:01:38,818 DEBUG [rs(jenkins-hbase4.apache.org,41057,1696496401070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07. 2023-10-05 09:01:38,818 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 09:01:38,818 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858. completed. 2023-10-05 09:01:38,818 DEBUG [rs(jenkins-hbase4.apache.org,40073,1696496401119)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858. 2023-10-05 09:01:38,818 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 09:01:38,818 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 09:01:38,818 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 09:01:38,818 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,818 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,818 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 09:01:38,818 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 09:01:38,818 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41057,1696496401070' in zk 2023-10-05 09:01:38,818 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40073,1696496401119' in zk 2023-10-05 09:01:38,821 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 09:01:38,821 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,821 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:38,821 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,821 DEBUG [member: 'jenkins-hbase4.apache.org,40073,1696496401119' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 09:01:38,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,821 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 09:01:38,822 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:38,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:38,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:38,822 DEBUG [member: 'jenkins-hbase4.apache.org,41057,1696496401070' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 09:01:38,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:38,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:38,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:38,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:38,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:38,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,826 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:01:38,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40073,1696496401119': 2023-10-05 09:01:38,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40073,1696496401119' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-05 09:01:38,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:38,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:38,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:38,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:38,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-05 09:01:38,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-05 09:01:38,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,827 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 09:01:38,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:38,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:38,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:38,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41057,1696496401070': 2023-10-05 09:01:38,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41057,1696496401070' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-05 09:01:38,829 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-05 09:01:38,829 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 09:01:38,829 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 09:01:38,829 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,830 INFO [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 09:01:38,831 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,831 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,831 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:38,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 09:01:38,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 09:01:38,831 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,831 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,831 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:38,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,831 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:38,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,832 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:38,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:38,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 09:01:38,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:38,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:38,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:38,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:38,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,832 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:38,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,832 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 09:01:38,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:38,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,834 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 09:01:38,834 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:38,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,835 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:38,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,837 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,838 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:38,838 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:38,838 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,838 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:38,838 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:38,838 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:38,838 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:38,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:38,838 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,838 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 09:01:38,838 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 09:01:38,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:38,838 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,838 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:38,838 DEBUG [(jenkins-hbase4.apache.org,37915,1696496399783)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 09:01:38,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:38,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:38,838 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 09:01:38,838 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 09:01:38,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 09:01:38,840 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:38,840 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,840 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:01:38,840 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:38,840 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,840 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:38,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:38,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 09:01:38,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 09:01:38,840 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310054dc12bc3b27041869e6b9b373d657184, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023100546349ccfbb9b48af9b4ba1a20168ca15] mob files 2023-10-05 09:01:38,840 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310054dc12bc3b27041869e6b9b373d657184 2023-10-05 09:01:38,840 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023100546349ccfbb9b48af9b4ba1a20168ca15 2023-10-05 09:01:38,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,866 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-05 09:01:38,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,867 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:38,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696496498725Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696496498850 (+125 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696496498850Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1696496498851 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1696496498853 (+2 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696496498860 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696496498866 (+6 ms) 2023-10-05 09:01:38,869 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 09:01:38,871 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 144 msec 2023-10-05 09:01:39,027 DEBUG [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 09:01:39,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-05 09:01:39,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 09:01:39,029 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496499029 2023-10-05 09:01:39,029 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45983, tgtDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496499029, rawTgtDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496499029, srcFsUri=hdfs://localhost:45983, srcDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c 2023-10-05 09:01:39,059 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45983, inputRoot=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c 2023-10-05 09:01:39,059 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_991762065_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496499029, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496499029/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:39,060 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45983, inputRoot=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c, snapshotDir=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-10-05 09:01:39,069 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496499029/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:39,097 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:39,098 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:39,098 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:39,098 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:39,099 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:39,099 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:39,099 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:39,165 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/hadoop-7343770079423102163.jar 2023-10-05 09:01:39,166 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:39,166 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:39,166 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:39,167 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:39,167 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:39,167 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 09:01:39,167 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 09:01:39,168 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 09:01:39,168 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 09:01:39,168 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 09:01:39,169 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 09:01:39,169 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 09:01:39,169 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 09:01:39,170 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 09:01:39,170 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 09:01:39,170 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 09:01:39,171 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:01:39,171 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:01:39,171 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 09:01:39,172 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:01:39,172 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 09:01:39,172 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 09:01:39,172 DEBUG [Listener at jenkins-hbase4.apache.org/41667] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 09:01:39,504 WARN [Listener at jenkins-hbase4.apache.org/41667] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 09:01:39,506 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-10-05 09:01:39,508 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-10-05 09:01:42,279 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 09:01:42,279 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 09:01:42,281 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0006_000001 (auth:SIMPLE) 2023-10-05 09:01:42,415 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0007_000001 (auth:SIMPLE) 2023-10-05 09:01:43,193 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 09:01:46,108 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0007_000001 (auth:SIMPLE) 2023-10-05 09:01:48,319 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0007_000001 (auth:SIMPLE) 2023-10-05 09:01:51,397 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0007_000001 (auth:SIMPLE) 2023-10-05 09:01:52,673 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 09:01:52,673 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 09:01:52,683 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:52,683 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 09:01:52,684 INFO [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 09:01:52,684 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_795266163_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:52,684 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-05 09:01:52,684 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-05 09:01:52,684 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_795266163_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496499029/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496499029/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:52,685 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496499029/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-05 09:01:52,685 DEBUG [Listener at jenkins-hbase4.apache.org/41667] snapshot.TestExportSnapshot(367): hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/export-test/export-1696496499029/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-05 09:01:52,691 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:52,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:52,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:52,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-05 09:01:52,695 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496512695"}]},"ts":"1696496512695"} 2023-10-05 09:01:52,696 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-10-05 09:01:52,698 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-10-05 09:01:52,699 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d98b4eec76d5347a857777e343c5c858, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1952dd96cda55729ed40887034685d07, UNASSIGN}] 2023-10-05 09:01:52,701 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d98b4eec76d5347a857777e343c5c858, UNASSIGN 2023-10-05 09:01:52,701 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1952dd96cda55729ed40887034685d07, UNASSIGN 2023-10-05 09:01:52,701 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=d98b4eec76d5347a857777e343c5c858, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:01:52,701 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=1952dd96cda55729ed40887034685d07, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:01:52,701 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696496512701"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496512701"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496512701"}]},"ts":"1696496512701"} 2023-10-05 09:01:52,701 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696496512701"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696496512701"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696496512701"}]},"ts":"1696496512701"} 2023-10-05 09:01:52,703 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure d98b4eec76d5347a857777e343c5c858, server=jenkins-hbase4.apache.org,40073,1696496401119}] 2023-10-05 09:01:52,703 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 1952dd96cda55729ed40887034685d07, server=jenkins-hbase4.apache.org,41057,1696496401070}] 2023-10-05 09:01:52,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-05 09:01:52,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d98b4eec76d5347a857777e343c5c858 2023-10-05 09:01:52,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d98b4eec76d5347a857777e343c5c858, disabling compactions & flushes 2023-10-05 09:01:52,855 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858. 2023-10-05 09:01:52,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858. 2023-10-05 09:01:52,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858. after waiting 0 ms 2023-10-05 09:01:52,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858. 2023-10-05 09:01:52,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1952dd96cda55729ed40887034685d07 2023-10-05 09:01:52,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1952dd96cda55729ed40887034685d07, disabling compactions & flushes 2023-10-05 09:01:52,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07. 2023-10-05 09:01:52,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07. 2023-10-05 09:01:52,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07. after waiting 0 ms 2023-10-05 09:01:52,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07. 2023-10-05 09:01:52,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithSkipTmp/d98b4eec76d5347a857777e343c5c858/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 09:01:52,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 09:01:52,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/default/testtb-testExportFileSystemStateWithSkipTmp/1952dd96cda55729ed40887034685d07/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 09:01:52,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858. 2023-10-05 09:01:52,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d98b4eec76d5347a857777e343c5c858: 2023-10-05 09:01:52,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 09:01:52,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07. 2023-10-05 09:01:52,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1952dd96cda55729ed40887034685d07: 2023-10-05 09:01:52,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d98b4eec76d5347a857777e343c5c858 2023-10-05 09:01:52,870 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=d98b4eec76d5347a857777e343c5c858, regionState=CLOSED 2023-10-05 09:01:52,870 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696496512870"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496512870"}]},"ts":"1696496512870"} 2023-10-05 09:01:52,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1952dd96cda55729ed40887034685d07 2023-10-05 09:01:52,870 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=1952dd96cda55729ed40887034685d07, regionState=CLOSED 2023-10-05 09:01:52,870 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696496512870"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696496512870"}]},"ts":"1696496512870"} 2023-10-05 09:01:52,872 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-10-05 09:01:52,872 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure d98b4eec76d5347a857777e343c5c858, server=jenkins-hbase4.apache.org,40073,1696496401119 in 168 msec 2023-10-05 09:01:52,873 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-10-05 09:01:52,873 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 1952dd96cda55729ed40887034685d07, server=jenkins-hbase4.apache.org,41057,1696496401070 in 169 msec 2023-10-05 09:01:52,874 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d98b4eec76d5347a857777e343c5c858, UNASSIGN in 173 msec 2023-10-05 09:01:52,875 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-10-05 09:01:52,875 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1952dd96cda55729ed40887034685d07, UNASSIGN in 174 msec 2023-10-05 09:01:52,876 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696496512876"}]},"ts":"1696496512876"} 2023-10-05 09:01:52,877 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-10-05 09:01:52,878 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-10-05 09:01:52,880 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 188 msec 2023-10-05 09:01:52,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-05 09:01:52,996 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-10-05 09:01:52,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:52,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:53,000 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:53,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:53,000 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:53,002 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40073] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:53,004 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d98b4eec76d5347a857777e343c5c858 2023-10-05 09:01:53,004 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1952dd96cda55729ed40887034685d07 2023-10-05 09:01:53,005 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:53,005 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:53,005 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:53,005 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:53,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-05 09:01:53,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-05 09:01:53,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-05 09:01:53,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-05 09:01:53,006 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d98b4eec76d5347a857777e343c5c858/cf, FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d98b4eec76d5347a857777e343c5c858/recovered.edits] 2023-10-05 09:01:53,006 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1952dd96cda55729ed40887034685d07/cf, FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1952dd96cda55729ed40887034685d07/recovered.edits] 2023-10-05 09:01:53,007 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:53,007 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:53,007 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:53,007 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:53,007 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:53,007 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:53,007 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:53,007 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 09:01:53,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-05 09:01:53,011 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d98b4eec76d5347a857777e343c5c858/cf/37053f054ab149f1884ab3f2542ce603 to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d98b4eec76d5347a857777e343c5c858/cf/37053f054ab149f1884ab3f2542ce603 2023-10-05 09:01:53,011 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1952dd96cda55729ed40887034685d07/cf/ca3800188e73478f9983b81fe0eb4f80 to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/1952dd96cda55729ed40887034685d07/cf/ca3800188e73478f9983b81fe0eb4f80 2023-10-05 09:01:53,014 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d98b4eec76d5347a857777e343c5c858/recovered.edits/9.seqid to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d98b4eec76d5347a857777e343c5c858/recovered.edits/9.seqid 2023-10-05 09:01:53,014 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1952dd96cda55729ed40887034685d07/recovered.edits/9.seqid to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/1952dd96cda55729ed40887034685d07/recovered.edits/9.seqid 2023-10-05 09:01:53,014 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d98b4eec76d5347a857777e343c5c858 2023-10-05 09:01:53,014 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1952dd96cda55729ed40887034685d07 2023-10-05 09:01:53,014 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-05 09:01:53,015 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-05 09:01:53,015 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-10-05 09:01:53,018 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310054dc12bc3b27041869e6b9b373d657184 to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310054dc12bc3b27041869e6b9b373d657184 2023-10-05 09:01:53,019 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023100546349ccfbb9b48af9b4ba1a20168ca15 to hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023100546349ccfbb9b48af9b4ba1a20168ca15 2023-10-05 09:01:53,020 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-05 09:01:53,022 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:53,023 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-10-05 09:01:53,025 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-10-05 09:01:53,026 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:53,026 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-10-05 09:01:53,026 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696496513026"}]},"ts":"9223372036854775807"} 2023-10-05 09:01:53,026 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696496513026"}]},"ts":"9223372036854775807"} 2023-10-05 09:01:53,028 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 09:01:53,028 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d98b4eec76d5347a857777e343c5c858, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696496497913.d98b4eec76d5347a857777e343c5c858.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1952dd96cda55729ed40887034685d07, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696496497913.1952dd96cda55729ed40887034685d07.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 09:01:53,028 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-10-05 09:01:53,028 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696496513028"}]},"ts":"9223372036854775807"} 2023-10-05 09:01:53,029 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-10-05 09:01:53,032 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:53,032 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 35 msec 2023-10-05 09:01:53,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-05 09:01:53,109 INFO [Listener at jenkins-hbase4.apache.org/41667] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-10-05 09:01:53,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-05 09:01:53,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:53,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-05 09:01:53,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37915] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 09:01:53,143 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 765), OpenFileDescriptor=920 (was 926), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=204 (was 164) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=5598 (was 5706) 2023-10-05 09:01:53,143 WARN [Listener at jenkins-hbase4.apache.org/41667] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-05 09:01:53,143 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-10-05 09:01:53,151 INFO [Listener at jenkins-hbase4.apache.org/41667] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-05 09:01:57,568 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696496407751_0007_000001 (auth:SIMPLE) 2023-10-05 09:01:58,436 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 09:02:07,275 INFO [Listener at jenkins-hbase4.apache.org/41667] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-05 09:02:21,393 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-05 09:02:21,394 INFO [Listener at jenkins-hbase4.apache.org/41667] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-05 09:02:21,504 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-10-05 09:02:21,514 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-10-05 09:02:21,515 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-05 09:02:21,523 INFO [Listener at jenkins-hbase4.apache.org/41667] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-05 09:02:21,627 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-05 09:02:21,627 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-10-05 09:02:21,627 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-05 09:02:21,627 INFO [Listener at jenkins-hbase4.apache.org/41667] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-05 09:02:21,627 DEBUG [Listener at jenkins-hbase4.apache.org/41667] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a39c81f to 127.0.0.1:63699 2023-10-05 09:02:21,627 DEBUG [Listener at jenkins-hbase4.apache.org/41667] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:02:21,628 DEBUG [Listener at jenkins-hbase4.apache.org/41667] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-05 09:02:21,628 DEBUG [Listener at jenkins-hbase4.apache.org/41667] util.JVMClusterUtil(257): Found active master hash=2141880036, stopped=false 2023-10-05 09:02:21,628 DEBUG [Listener at jenkins-hbase4.apache.org/41667] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 09:02:21,628 DEBUG [Listener at jenkins-hbase4.apache.org/41667] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-05 09:02:21,628 INFO [Listener at jenkins-hbase4.apache.org/41667] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37915,1696496399783 2023-10-05 09:02:21,629 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-05 09:02:21,629 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-05 09:02:21,629 INFO [Listener at jenkins-hbase4.apache.org/41667] procedure2.ProcedureExecutor(628): Stopping 2023-10-05 09:02:21,629 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-05 09:02:21,629 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-05 09:02:21,629 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 09:02:21,630 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 09:02:21,630 DEBUG [Listener at jenkins-hbase4.apache.org/41667] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17d8be45 to 127.0.0.1:63699 2023-10-05 09:02:21,630 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 09:02:21,630 DEBUG [Listener at jenkins-hbase4.apache.org/41667] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:02:21,630 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 09:02:21,630 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 09:02:21,630 INFO [Listener at jenkins-hbase4.apache.org/41667] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41057,1696496401070' ***** 2023-10-05 09:02:21,630 DEBUG [Listener at jenkins-hbase4.apache.org/41667] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 09:02:21,631 INFO [Listener at jenkins-hbase4.apache.org/41667] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-05 09:02:21,631 INFO [Listener at jenkins-hbase4.apache.org/41667] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40073,1696496401119' ***** 2023-10-05 09:02:21,631 INFO [RS:0;jenkins-hbase4:41057] regionserver.HeapMemoryManager(220): Stopping 2023-10-05 09:02:21,631 DEBUG [Listener at jenkins-hbase4.apache.org/41667] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 09:02:21,631 INFO [Listener at jenkins-hbase4.apache.org/41667] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-05 09:02:21,631 INFO [RS:0;jenkins-hbase4:41057] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-05 09:02:21,631 INFO [Listener at jenkins-hbase4.apache.org/41667] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35953,1696496401154' ***** 2023-10-05 09:02:21,631 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-05 09:02:21,631 DEBUG [Listener at jenkins-hbase4.apache.org/41667] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 09:02:21,631 INFO [RS:0;jenkins-hbase4:41057] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-05 09:02:21,631 INFO [Listener at jenkins-hbase4.apache.org/41667] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-05 09:02:21,631 INFO [RS:1;jenkins-hbase4:40073] regionserver.HeapMemoryManager(220): Stopping 2023-10-05 09:02:21,631 INFO [RS:2;jenkins-hbase4:35953] regionserver.HeapMemoryManager(220): Stopping 2023-10-05 09:02:21,632 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-05 09:02:21,632 INFO [RS:2;jenkins-hbase4:35953] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-05 09:02:21,632 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-05 09:02:21,632 INFO [RS:1;jenkins-hbase4:40073] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-05 09:02:21,632 INFO [RS:1;jenkins-hbase4:40073] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-05 09:02:21,632 INFO [RS:0;jenkins-hbase4:41057] regionserver.HRegionServer(3305): Received CLOSE for 44bd4d94cbec1f6f51e791a78c3b441b 2023-10-05 09:02:21,632 INFO [RS:2;jenkins-hbase4:35953] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-05 09:02:21,632 INFO [RS:1;jenkins-hbase4:40073] regionserver.HRegionServer(3305): Received CLOSE for 0bb59e34ca1c72ee82135cd60b6409dd 2023-10-05 09:02:21,632 INFO [RS:2;jenkins-hbase4:35953] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:02:21,632 DEBUG [RS:2;jenkins-hbase4:35953] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48048430 to 127.0.0.1:63699 2023-10-05 09:02:21,632 DEBUG [RS:2;jenkins-hbase4:35953] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:02:21,632 INFO [RS:0;jenkins-hbase4:41057] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:02:21,632 INFO [RS:1;jenkins-hbase4:40073] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:02:21,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 44bd4d94cbec1f6f51e791a78c3b441b, disabling compactions & flushes 2023-10-05 09:02:21,635 DEBUG [RS:1;jenkins-hbase4:40073] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x403e3bcc to 127.0.0.1:63699 2023-10-05 09:02:21,632 DEBUG [RS:0;jenkins-hbase4:41057] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42f5b19b to 127.0.0.1:63699 2023-10-05 09:02:21,635 DEBUG [RS:1;jenkins-hbase4:40073] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:02:21,635 DEBUG [RS:0;jenkins-hbase4:41057] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:02:21,635 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696496403485.44bd4d94cbec1f6f51e791a78c3b441b. 2023-10-05 09:02:21,635 INFO [RS:2;jenkins-hbase4:35953] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35953,1696496401154; all regions closed. 2023-10-05 09:02:21,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0bb59e34ca1c72ee82135cd60b6409dd, disabling compactions & flushes 2023-10-05 09:02:21,636 INFO [RS:0;jenkins-hbase4:41057] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-05 09:02:21,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696496403485.44bd4d94cbec1f6f51e791a78c3b441b. 2023-10-05 09:02:21,636 INFO [RS:1;jenkins-hbase4:40073] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-05 09:02:21,637 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696496403485.44bd4d94cbec1f6f51e791a78c3b441b. after waiting 1 ms 2023-10-05 09:02:21,637 DEBUG [RS:1;jenkins-hbase4:40073] regionserver.HRegionServer(1478): Online Regions={0bb59e34ca1c72ee82135cd60b6409dd=hbase:acl,,1696496404225.0bb59e34ca1c72ee82135cd60b6409dd.} 2023-10-05 09:02:21,636 INFO [RS:0;jenkins-hbase4:41057] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-05 09:02:21,636 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696496404225.0bb59e34ca1c72ee82135cd60b6409dd. 2023-10-05 09:02:21,637 INFO [RS:0;jenkins-hbase4:41057] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-05 09:02:21,637 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696496403485.44bd4d94cbec1f6f51e791a78c3b441b. 2023-10-05 09:02:21,637 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696496404225.0bb59e34ca1c72ee82135cd60b6409dd. 2023-10-05 09:02:21,637 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 44bd4d94cbec1f6f51e791a78c3b441b 1/1 column families, dataSize=78 B heapSize=488 B 2023-10-05 09:02:21,637 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696496404225.0bb59e34ca1c72ee82135cd60b6409dd. after waiting 0 ms 2023-10-05 09:02:21,637 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696496404225.0bb59e34ca1c72ee82135cd60b6409dd. 2023-10-05 09:02:21,637 INFO [RS:0;jenkins-hbase4:41057] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-05 09:02:21,637 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 0bb59e34ca1c72ee82135cd60b6409dd 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-10-05 09:02:21,637 INFO [RS:0;jenkins-hbase4:41057] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-10-05 09:02:21,637 DEBUG [RS:0;jenkins-hbase4:41057] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, 44bd4d94cbec1f6f51e791a78c3b441b=hbase:namespace,,1696496403485.44bd4d94cbec1f6f51e791a78c3b441b.} 2023-10-05 09:02:21,638 DEBUG [RS:0;jenkins-hbase4:41057] regionserver.HRegionServer(1504): Waiting on 1588230740, 44bd4d94cbec1f6f51e791a78c3b441b 2023-10-05 09:02:21,638 DEBUG [RS:1;jenkins-hbase4:40073] regionserver.HRegionServer(1504): Waiting on 0bb59e34ca1c72ee82135cd60b6409dd 2023-10-05 09:02:21,638 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-05 09:02:21,638 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-05 09:02:21,638 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-05 09:02:21,638 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-05 09:02:21,638 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-05 09:02:21,638 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-10-05 09:02:21,653 DEBUG [RS:2;jenkins-hbase4:35953] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/oldWALs 2023-10-05 09:02:21,653 INFO [RS:2;jenkins-hbase4:35953] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35953%2C1696496401154:(num 1696496402876) 2023-10-05 09:02:21,653 DEBUG [RS:2;jenkins-hbase4:35953] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:02:21,654 INFO [RS:2;jenkins-hbase4:35953] regionserver.LeaseManager(133): Closed leases 2023-10-05 09:02:21,655 INFO [RS:2;jenkins-hbase4:35953] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-05 09:02:21,655 INFO [RS:2;jenkins-hbase4:35953] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-05 09:02:21,655 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-05 09:02:21,655 INFO [RS:2;jenkins-hbase4:35953] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-05 09:02:21,655 INFO [RS:2;jenkins-hbase4:35953] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-05 09:02:21,660 INFO [RS:2;jenkins-hbase4:35953] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35953 2023-10-05 09:02:21,667 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:02:21,667 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 09:02:21,667 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:02:21,667 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35953,1696496401154 2023-10-05 09:02:21,667 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 09:02:21,667 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 09:02:21,667 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 09:02:21,674 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/acl/0bb59e34ca1c72ee82135cd60b6409dd/.tmp/l/a53f3f2b9551487f8f8245fe36fc35dc 2023-10-05 09:02:21,675 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35953,1696496401154] 2023-10-05 09:02:21,677 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/1588230740/.tmp/info/b11eaf70833847babcc99375e81b729b 2023-10-05 09:02:21,678 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35953,1696496401154; numProcessing=1 2023-10-05 09:02:21,681 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35953,1696496401154 already deleted, retry=false 2023-10-05 09:02:21,681 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35953,1696496401154 expired; onlineServers=2 2023-10-05 09:02:21,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/namespace/44bd4d94cbec1f6f51e791a78c3b441b/.tmp/info/b521b740efe441d3b2d8d77b8b57c627 2023-10-05 09:02:21,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a53f3f2b9551487f8f8245fe36fc35dc 2023-10-05 09:02:21,688 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b11eaf70833847babcc99375e81b729b 2023-10-05 09:02:21,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/acl/0bb59e34ca1c72ee82135cd60b6409dd/.tmp/l/a53f3f2b9551487f8f8245fe36fc35dc as hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/acl/0bb59e34ca1c72ee82135cd60b6409dd/l/a53f3f2b9551487f8f8245fe36fc35dc 2023-10-05 09:02:21,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/namespace/44bd4d94cbec1f6f51e791a78c3b441b/.tmp/info/b521b740efe441d3b2d8d77b8b57c627 as hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/namespace/44bd4d94cbec1f6f51e791a78c3b441b/info/b521b740efe441d3b2d8d77b8b57c627 2023-10-05 09:02:21,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/namespace/44bd4d94cbec1f6f51e791a78c3b441b/info/b521b740efe441d3b2d8d77b8b57c627, entries=2, sequenceid=6, filesize=4.8 K 2023-10-05 09:02:21,698 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-05 09:02:21,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a53f3f2b9551487f8f8245fe36fc35dc 2023-10-05 09:02:21,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/acl/0bb59e34ca1c72ee82135cd60b6409dd/l/a53f3f2b9551487f8f8245fe36fc35dc, entries=7, sequenceid=18, filesize=5.2 K 2023-10-05 09:02:21,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 44bd4d94cbec1f6f51e791a78c3b441b in 61ms, sequenceid=6, compaction requested=false 2023-10-05 09:02:21,700 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-05 09:02:21,701 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-05 09:02:21,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 0bb59e34ca1c72ee82135cd60b6409dd in 65ms, sequenceid=18, compaction requested=false 2023-10-05 09:02:21,708 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/1588230740/.tmp/rep_barrier/a71813537c95489dbfeed91f9dc2d0ff 2023-10-05 09:02:21,710 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-10-05 09:02:21,710 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-10-05 09:02:21,722 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a71813537c95489dbfeed91f9dc2d0ff 2023-10-05 09:02:21,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/namespace/44bd4d94cbec1f6f51e791a78c3b441b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 09:02:21,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/acl/0bb59e34ca1c72ee82135cd60b6409dd/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-10-05 09:02:21,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 09:02:21,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696496403485.44bd4d94cbec1f6f51e791a78c3b441b. 2023-10-05 09:02:21,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 44bd4d94cbec1f6f51e791a78c3b441b: 2023-10-05 09:02:21,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1696496403485.44bd4d94cbec1f6f51e791a78c3b441b. 2023-10-05 09:02:21,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 09:02:21,727 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1696496404225.0bb59e34ca1c72ee82135cd60b6409dd. 2023-10-05 09:02:21,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0bb59e34ca1c72ee82135cd60b6409dd: 2023-10-05 09:02:21,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1696496404225.0bb59e34ca1c72ee82135cd60b6409dd. 2023-10-05 09:02:21,737 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/1588230740/.tmp/table/ac3b0cea0d5d4676b7c20666f4b794d9 2023-10-05 09:02:21,741 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ac3b0cea0d5d4676b7c20666f4b794d9 2023-10-05 09:02:21,742 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/1588230740/.tmp/info/b11eaf70833847babcc99375e81b729b as hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/1588230740/info/b11eaf70833847babcc99375e81b729b 2023-10-05 09:02:21,746 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b11eaf70833847babcc99375e81b729b 2023-10-05 09:02:21,746 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/1588230740/info/b11eaf70833847babcc99375e81b729b, entries=48, sequenceid=131, filesize=10.3 K 2023-10-05 09:02:21,747 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/1588230740/.tmp/rep_barrier/a71813537c95489dbfeed91f9dc2d0ff as hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/1588230740/rep_barrier/a71813537c95489dbfeed91f9dc2d0ff 2023-10-05 09:02:21,751 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a71813537c95489dbfeed91f9dc2d0ff 2023-10-05 09:02:21,751 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/1588230740/rep_barrier/a71813537c95489dbfeed91f9dc2d0ff, entries=13, sequenceid=131, filesize=6.4 K 2023-10-05 09:02:21,752 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/1588230740/.tmp/table/ac3b0cea0d5d4676b7c20666f4b794d9 as hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/1588230740/table/ac3b0cea0d5d4676b7c20666f4b794d9 2023-10-05 09:02:21,756 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ac3b0cea0d5d4676b7c20666f4b794d9 2023-10-05 09:02:21,756 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/1588230740/table/ac3b0cea0d5d4676b7c20666f4b794d9, entries=24, sequenceid=131, filesize=6.9 K 2023-10-05 09:02:21,757 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 119ms, sequenceid=131, compaction requested=false 2023-10-05 09:02:21,766 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-10-05 09:02:21,766 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 09:02:21,766 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-05 09:02:21,767 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-05 09:02:21,767 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-05 09:02:21,767 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-05 09:02:21,768 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-10-05 09:02:21,768 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-10-05 09:02:21,776 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 09:02:21,776 INFO [RS:2;jenkins-hbase4:35953] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35953,1696496401154; zookeeper connection closed. 2023-10-05 09:02:21,776 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:35953-0x10115cfe9c60003, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 09:02:21,777 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@53d1c1f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@53d1c1f 2023-10-05 09:02:21,838 INFO [RS:0;jenkins-hbase4:41057] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41057,1696496401070; all regions closed. 2023-10-05 09:02:21,838 INFO [RS:1;jenkins-hbase4:40073] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40073,1696496401119; all regions closed. 2023-10-05 09:02:21,844 DEBUG [RS:1;jenkins-hbase4:40073] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/oldWALs 2023-10-05 09:02:21,844 DEBUG [RS:0;jenkins-hbase4:41057] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/oldWALs 2023-10-05 09:02:21,844 INFO [RS:1;jenkins-hbase4:40073] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40073%2C1696496401119:(num 1696496402876) 2023-10-05 09:02:21,844 INFO [RS:0;jenkins-hbase4:41057] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41057%2C1696496401070.meta:.meta(num 1696496403155) 2023-10-05 09:02:21,844 DEBUG [RS:1;jenkins-hbase4:40073] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:02:21,844 INFO [RS:1;jenkins-hbase4:40073] regionserver.LeaseManager(133): Closed leases 2023-10-05 09:02:21,845 INFO [RS:1;jenkins-hbase4:40073] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-05 09:02:21,845 INFO [RS:1;jenkins-hbase4:40073] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-05 09:02:21,845 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-05 09:02:21,845 INFO [RS:1;jenkins-hbase4:40073] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-05 09:02:21,845 INFO [RS:1;jenkins-hbase4:40073] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-05 09:02:21,846 INFO [RS:1;jenkins-hbase4:40073] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40073 2023-10-05 09:02:21,849 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 09:02:21,849 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:02:21,849 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40073,1696496401119 2023-10-05 09:02:21,850 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40073,1696496401119] 2023-10-05 09:02:21,850 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40073,1696496401119; numProcessing=2 2023-10-05 09:02:21,851 DEBUG [RS:0;jenkins-hbase4:41057] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/oldWALs 2023-10-05 09:02:21,851 INFO [RS:0;jenkins-hbase4:41057] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41057%2C1696496401070:(num 1696496402876) 2023-10-05 09:02:21,851 DEBUG [RS:0;jenkins-hbase4:41057] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:02:21,851 INFO [RS:0;jenkins-hbase4:41057] regionserver.LeaseManager(133): Closed leases 2023-10-05 09:02:21,851 INFO [RS:0;jenkins-hbase4:41057] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-05 09:02:21,851 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40073,1696496401119 already deleted, retry=false 2023-10-05 09:02:21,851 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-05 09:02:21,851 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40073,1696496401119 expired; onlineServers=1 2023-10-05 09:02:21,852 INFO [RS:0;jenkins-hbase4:41057] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41057 2023-10-05 09:02:21,854 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41057,1696496401070 2023-10-05 09:02:21,854 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 09:02:21,855 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41057,1696496401070] 2023-10-05 09:02:21,855 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41057,1696496401070; numProcessing=3 2023-10-05 09:02:21,857 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41057,1696496401070 already deleted, retry=false 2023-10-05 09:02:21,857 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41057,1696496401070 expired; onlineServers=0 2023-10-05 09:02:21,857 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37915,1696496399783' ***** 2023-10-05 09:02:21,857 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-05 09:02:21,857 DEBUG [M:0;jenkins-hbase4:37915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e9774df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-05 09:02:21,857 INFO [M:0;jenkins-hbase4:37915] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37915,1696496399783 2023-10-05 09:02:21,857 INFO [M:0;jenkins-hbase4:37915] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37915,1696496399783; all regions closed. 2023-10-05 09:02:21,857 DEBUG [M:0;jenkins-hbase4:37915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 09:02:21,857 DEBUG [M:0;jenkins-hbase4:37915] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-05 09:02:21,857 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-05 09:02:21,857 DEBUG [M:0;jenkins-hbase4:37915] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-05 09:02:21,857 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696496402492] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696496402492,5,FailOnTimeoutGroup] 2023-10-05 09:02:21,857 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696496402492] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696496402492,5,FailOnTimeoutGroup] 2023-10-05 09:02:21,857 INFO [M:0;jenkins-hbase4:37915] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-05 09:02:21,858 INFO [M:0;jenkins-hbase4:37915] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-05 09:02:21,858 INFO [M:0;jenkins-hbase4:37915] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-10-05 09:02:21,858 DEBUG [M:0;jenkins-hbase4:37915] master.HMaster(1512): Stopping service threads 2023-10-05 09:02:21,858 INFO [M:0;jenkins-hbase4:37915] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-05 09:02:21,858 ERROR [M:0;jenkins-hbase4:37915] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-10-05 09:02:21,858 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-10-05 09:02:21,858 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 09:02:21,859 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 09:02:21,859 INFO [M:0;jenkins-hbase4:37915] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-05 09:02:21,859 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-05 09:02:21,859 DEBUG [M:0;jenkins-hbase4:37915] zookeeper.ZKUtil(398): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-05 09:02:21,859 WARN [M:0;jenkins-hbase4:37915] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-05 09:02:21,859 INFO [M:0;jenkins-hbase4:37915] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-05 09:02:21,860 INFO [M:0;jenkins-hbase4:37915] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-05 09:02:21,860 DEBUG [M:0;jenkins-hbase4:37915] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-05 09:02:21,860 INFO [M:0;jenkins-hbase4:37915] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 09:02:21,860 DEBUG [M:0;jenkins-hbase4:37915] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 09:02:21,860 DEBUG [M:0;jenkins-hbase4:37915] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-05 09:02:21,860 DEBUG [M:0;jenkins-hbase4:37915] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 09:02:21,860 INFO [M:0;jenkins-hbase4:37915] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.59 KB heapSize=451.89 KB 2023-10-05 09:02:21,872 INFO [M:0;jenkins-hbase4:37915] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.59 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/de520ae338364ca19d939f1632b39f9b 2023-10-05 09:02:21,876 INFO [M:0;jenkins-hbase4:37915] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for de520ae338364ca19d939f1632b39f9b 2023-10-05 09:02:21,877 DEBUG [M:0;jenkins-hbase4:37915] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/de520ae338364ca19d939f1632b39f9b as hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/de520ae338364ca19d939f1632b39f9b 2023-10-05 09:02:21,880 INFO [M:0;jenkins-hbase4:37915] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for de520ae338364ca19d939f1632b39f9b 2023-10-05 09:02:21,880 INFO [M:0;jenkins-hbase4:37915] regionserver.HStore(1080): Added hdfs://localhost:45983/user/jenkins/test-data/86a1ad28-53da-d372-8054-9052660ffc0c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/de520ae338364ca19d939f1632b39f9b, entries=119, sequenceid=899, filesize=28.6 K 2023-10-05 09:02:21,881 INFO [M:0;jenkins-hbase4:37915] regionserver.HRegion(2948): Finished flush of dataSize ~375.59 KB/384605, heapSize ~451.88 KB/462720, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=899, compaction requested=false 2023-10-05 09:02:21,882 INFO [M:0;jenkins-hbase4:37915] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 09:02:21,882 DEBUG [M:0;jenkins-hbase4:37915] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-05 09:02:21,886 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-05 09:02:21,886 INFO [M:0;jenkins-hbase4:37915] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-05 09:02:21,886 INFO [M:0;jenkins-hbase4:37915] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37915 2023-10-05 09:02:21,888 DEBUG [M:0;jenkins-hbase4:37915] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37915,1696496399783 already deleted, retry=false 2023-10-05 09:02:21,950 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 09:02:21,950 INFO [RS:1;jenkins-hbase4:40073] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40073,1696496401119; zookeeper connection closed. 2023-10-05 09:02:21,951 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:40073-0x10115cfe9c60002, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 09:02:21,951 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5a8eafb0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5a8eafb0 2023-10-05 09:02:22,051 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 09:02:22,051 INFO [M:0;jenkins-hbase4:37915] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37915,1696496399783; zookeeper connection closed. 2023-10-05 09:02:22,051 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): master:37915-0x10115cfe9c60000, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 09:02:22,151 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 09:02:22,151 INFO [RS:0;jenkins-hbase4:41057] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41057,1696496401070; zookeeper connection closed. 2023-10-05 09:02:22,151 DEBUG [Listener at localhost/46441-EventThread] zookeeper.ZKWatcher(600): regionserver:41057-0x10115cfe9c60001, quorum=127.0.0.1:63699, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 09:02:22,151 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4db2451d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4db2451d 2023-10-05 09:02:22,151 INFO [Listener at jenkins-hbase4.apache.org/41667] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-10-05 09:02:22,152 WARN [Listener at jenkins-hbase4.apache.org/41667] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-05 09:02:22,154 INFO [Listener at jenkins-hbase4.apache.org/41667] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-05 09:02:22,257 WARN [BP-1177565841-172.31.14.131-1696496396405 heartbeating to localhost/127.0.0.1:45983] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-05 09:02:22,258 WARN [BP-1177565841-172.31.14.131-1696496396405 heartbeating to localhost/127.0.0.1:45983] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1177565841-172.31.14.131-1696496396405 (Datanode Uuid 06c9bf79-ab11-4ff6-a4a2-fd5d3f60aa47) service to localhost/127.0.0.1:45983 2023-10-05 09:02:22,259 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/cluster_b0202d10-b338-417a-fd42-e9b01be8eb27/dfs/data/data5/current/BP-1177565841-172.31.14.131-1696496396405] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 09:02:22,259 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/cluster_b0202d10-b338-417a-fd42-e9b01be8eb27/dfs/data/data6/current/BP-1177565841-172.31.14.131-1696496396405] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 09:02:22,260 WARN [Listener at jenkins-hbase4.apache.org/41667] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-05 09:02:22,262 INFO [Listener at jenkins-hbase4.apache.org/41667] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-05 09:02:22,365 WARN [BP-1177565841-172.31.14.131-1696496396405 heartbeating to localhost/127.0.0.1:45983] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-05 09:02:22,365 WARN [BP-1177565841-172.31.14.131-1696496396405 heartbeating to localhost/127.0.0.1:45983] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1177565841-172.31.14.131-1696496396405 (Datanode Uuid 2d57baff-58d4-4ef6-8cca-ba5afb4aabd2) service to localhost/127.0.0.1:45983 2023-10-05 09:02:22,366 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/cluster_b0202d10-b338-417a-fd42-e9b01be8eb27/dfs/data/data3/current/BP-1177565841-172.31.14.131-1696496396405] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 09:02:22,366 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/cluster_b0202d10-b338-417a-fd42-e9b01be8eb27/dfs/data/data4/current/BP-1177565841-172.31.14.131-1696496396405] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 09:02:22,367 WARN [Listener at jenkins-hbase4.apache.org/41667] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-05 09:02:22,369 INFO [Listener at jenkins-hbase4.apache.org/41667] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-05 09:02:22,471 WARN [BP-1177565841-172.31.14.131-1696496396405 heartbeating to localhost/127.0.0.1:45983] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-05 09:02:22,471 WARN [BP-1177565841-172.31.14.131-1696496396405 heartbeating to localhost/127.0.0.1:45983] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1177565841-172.31.14.131-1696496396405 (Datanode Uuid 8ce18163-78c5-466b-b973-eb55768da98f) service to localhost/127.0.0.1:45983 2023-10-05 09:02:22,472 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/cluster_b0202d10-b338-417a-fd42-e9b01be8eb27/dfs/data/data1/current/BP-1177565841-172.31.14.131-1696496396405] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 09:02:22,472 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1ce5575e-3f25-384a-77d2-17f1d92ff532/cluster_b0202d10-b338-417a-fd42-e9b01be8eb27/dfs/data/data2/current/BP-1177565841-172.31.14.131-1696496396405] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 09:02:22,494 INFO [Listener at jenkins-hbase4.apache.org/41667] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-05 09:02:22,620 INFO [Listener at jenkins-hbase4.apache.org/41667] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-05 09:02:22,705 INFO [Listener at jenkins-hbase4.apache.org/41667] hbase.HBaseTestingUtility(1293): Minicluster is down