2023-10-01 02:01:03,006 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-10-01 02:01:03,219 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117 2023-10-01 02:01:03,219 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-10-01 02:01:03,219 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-10-01 02:01:03,259 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-01 02:01:03,537 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-01 02:01:03,537 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/cluster_33985e5d-e43f-94f3-71d6-02862cb1aecc, deleteOnExit=true 2023-10-01 02:01:03,538 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-01 02:01:03,539 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/test.cache.data in system properties and HBase conf 2023-10-01 02:01:03,539 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/hadoop.tmp.dir in system properties and HBase conf 2023-10-01 02:01:03,540 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/hadoop.log.dir in system properties and HBase conf 2023-10-01 02:01:03,540 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-01 02:01:03,541 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-01 02:01:03,541 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-01 02:01:03,848 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-01 02:01:03,853 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-01 02:01:03,854 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-01 02:01:03,854 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-01 02:01:03,854 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-01 02:01:03,855 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-01 02:01:03,855 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-01 02:01:03,855 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-01 02:01:03,856 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-01 02:01:03,856 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-01 02:01:03,856 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/nfs.dump.dir in system properties and HBase conf 2023-10-01 02:01:03,856 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/java.io.tmpdir in system properties and HBase conf 2023-10-01 02:01:03,857 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-01 02:01:03,857 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-01 02:01:03,857 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-01 02:01:04,397 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-01 02:01:04,401 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-01 02:01:04,671 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-01 02:01:04,867 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-01 02:01:04,886 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 02:01:04,920 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 02:01:04,949 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/java.io.tmpdir/Jetty_localhost_40611_hdfs____.ou2v0c/webapp 2023-10-01 02:01:05,075 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40611 2023-10-01 02:01:05,131 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-01 02:01:05,131 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-01 02:01:05,586 WARN [Listener at localhost/33385] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-01 02:01:05,663 WARN [Listener at localhost/33385] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-01 02:01:05,688 WARN [Listener at localhost/33385] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 02:01:05,697 INFO [Listener at localhost/33385] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 02:01:05,703 INFO [Listener at localhost/33385] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/java.io.tmpdir/Jetty_localhost_44699_datanode____a1elh9/webapp 2023-10-01 02:01:05,795 INFO [Listener at localhost/33385] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44699 2023-10-01 02:01:06,256 WARN [Listener at localhost/38843] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-01 02:01:06,274 WARN [Listener at localhost/38843] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-01 02:01:06,280 WARN [Listener at localhost/38843] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 02:01:06,283 INFO [Listener at localhost/38843] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 02:01:06,289 INFO [Listener at localhost/38843] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/java.io.tmpdir/Jetty_localhost_46723_datanode____yp0kil/webapp 2023-10-01 02:01:06,375 INFO [Listener at localhost/38843] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46723 2023-10-01 02:01:06,389 WARN [Listener at localhost/34021] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-01 02:01:06,407 WARN [Listener at localhost/34021] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-01 02:01:06,413 WARN [Listener at localhost/34021] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 02:01:06,415 INFO [Listener at localhost/34021] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 02:01:06,423 INFO [Listener at localhost/34021] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/java.io.tmpdir/Jetty_localhost_37681_datanode____9i9y5u/webapp 2023-10-01 02:01:06,522 INFO [Listener at localhost/34021] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37681 2023-10-01 02:01:06,545 WARN [Listener at localhost/46623] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-01 02:01:06,859 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb333c557c6a0f7ef: Processing first storage report for DS-b8127a02-dbf7-4678-a303-9b5465c96be0 from datanode e4ac19e1-c7b4-4bca-9490-2954115e0c3c 2023-10-01 02:01:06,861 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb333c557c6a0f7ef: from storage DS-b8127a02-dbf7-4678-a303-9b5465c96be0 node DatanodeRegistration(127.0.0.1:33679, datanodeUuid=e4ac19e1-c7b4-4bca-9490-2954115e0c3c, infoPort=37963, infoSecurePort=0, ipcPort=46623, storageInfo=lv=-57;cid=testClusterID;nsid=902707211;c=1696125664470), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-10-01 02:01:06,862 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb333c557c6a0f7ef: Processing first storage report for DS-b23b76e4-97ff-4f40-a2ae-f8c82d2ccbcb from datanode e4ac19e1-c7b4-4bca-9490-2954115e0c3c 2023-10-01 02:01:06,862 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb333c557c6a0f7ef: from storage DS-b23b76e4-97ff-4f40-a2ae-f8c82d2ccbcb node DatanodeRegistration(127.0.0.1:33679, datanodeUuid=e4ac19e1-c7b4-4bca-9490-2954115e0c3c, infoPort=37963, infoSecurePort=0, ipcPort=46623, storageInfo=lv=-57;cid=testClusterID;nsid=902707211;c=1696125664470), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-01 02:01:06,865 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb0963ec0fe715089: Processing first storage report for DS-652e8f7e-14a8-4981-b8c3-302afb26a1eb from datanode d771726b-5b72-4c3e-8dbd-94b8053687f4 2023-10-01 02:01:06,866 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb0963ec0fe715089: from storage DS-652e8f7e-14a8-4981-b8c3-302afb26a1eb node DatanodeRegistration(127.0.0.1:42751, datanodeUuid=d771726b-5b72-4c3e-8dbd-94b8053687f4, infoPort=34975, infoSecurePort=0, ipcPort=34021, storageInfo=lv=-57;cid=testClusterID;nsid=902707211;c=1696125664470), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-01 02:01:06,866 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x74c7df95e288f676: Processing first storage report for DS-3042c49a-6f70-461c-b104-93fc378232a4 from datanode 2fbdcc11-7aba-457b-8f23-22889c4ac184 2023-10-01 02:01:06,866 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x74c7df95e288f676: from storage DS-3042c49a-6f70-461c-b104-93fc378232a4 node DatanodeRegistration(127.0.0.1:42031, datanodeUuid=2fbdcc11-7aba-457b-8f23-22889c4ac184, infoPort=46033, infoSecurePort=0, ipcPort=38843, storageInfo=lv=-57;cid=testClusterID;nsid=902707211;c=1696125664470), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-01 02:01:06,866 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x74c7df95e288f676: Processing first storage report for DS-e56da9e0-a6a4-464a-a2da-7dc21260531a from datanode 2fbdcc11-7aba-457b-8f23-22889c4ac184 2023-10-01 02:01:06,866 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x74c7df95e288f676: from storage DS-e56da9e0-a6a4-464a-a2da-7dc21260531a node DatanodeRegistration(127.0.0.1:42031, datanodeUuid=2fbdcc11-7aba-457b-8f23-22889c4ac184, infoPort=46033, infoSecurePort=0, ipcPort=38843, storageInfo=lv=-57;cid=testClusterID;nsid=902707211;c=1696125664470), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-01 02:01:06,867 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb0963ec0fe715089: Processing first storage report for DS-c4035910-8433-4fa0-858a-03d07821d42c from datanode d771726b-5b72-4c3e-8dbd-94b8053687f4 2023-10-01 02:01:06,867 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb0963ec0fe715089: from storage DS-c4035910-8433-4fa0-858a-03d07821d42c node DatanodeRegistration(127.0.0.1:42751, datanodeUuid=d771726b-5b72-4c3e-8dbd-94b8053687f4, infoPort=34975, infoSecurePort=0, ipcPort=34021, storageInfo=lv=-57;cid=testClusterID;nsid=902707211;c=1696125664470), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-01 02:01:07,036 DEBUG [Listener at localhost/46623] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117 2023-10-01 02:01:07,131 INFO [Listener at localhost/46623] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/cluster_33985e5d-e43f-94f3-71d6-02862cb1aecc/zookeeper_0, clientPort=51733, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/cluster_33985e5d-e43f-94f3-71d6-02862cb1aecc/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/cluster_33985e5d-e43f-94f3-71d6-02862cb1aecc/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-01 02:01:07,154 INFO [Listener at localhost/46623] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51733 2023-10-01 02:01:07,164 INFO [Listener at localhost/46623] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 02:01:07,166 INFO [Listener at localhost/46623] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 02:01:07,846 INFO [Listener at localhost/46623] util.FSUtils(471): Created version file at hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae with version=8 2023-10-01 02:01:07,846 INFO [Listener at localhost/46623] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/hbase-staging 2023-10-01 02:01:08,204 INFO [Listener at localhost/46623] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-01 02:01:08,612 INFO [Listener at localhost/46623] client.ConnectionUtils(127): master/jenkins-hbase17:0 server-side Connection retries=45 2023-10-01 02:01:08,639 INFO [Listener at localhost/46623] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 02:01:08,640 INFO [Listener at localhost/46623] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-01 02:01:08,640 INFO [Listener at localhost/46623] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-01 02:01:08,640 INFO [Listener at localhost/46623] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 02:01:08,640 INFO [Listener at localhost/46623] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-01 02:01:08,774 INFO [Listener at localhost/46623] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-01 02:01:08,843 DEBUG [Listener at localhost/46623] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-01 02:01:08,935 INFO [Listener at localhost/46623] ipc.NettyRpcServer(120): Bind to /136.243.18.41:37789 2023-10-01 02:01:08,945 INFO [Listener at localhost/46623] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 02:01:08,947 INFO [Listener at localhost/46623] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 02:01:08,968 INFO [Listener at localhost/46623] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37789 connecting to ZooKeeper ensemble=127.0.0.1:51733 2023-10-01 02:01:09,029 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:377890x0, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-01 02:01:09,032 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:37789-0x100ffb602650000 connected 2023-10-01 02:01:09,057 DEBUG [Listener at localhost/46623] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-01 02:01:09,057 DEBUG [Listener at localhost/46623] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 02:01:09,069 DEBUG [Listener at localhost/46623] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-01 02:01:09,078 DEBUG [Listener at localhost/46623] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37789 2023-10-01 02:01:09,079 DEBUG [Listener at localhost/46623] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37789 2023-10-01 02:01:09,079 DEBUG [Listener at localhost/46623] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37789 2023-10-01 02:01:09,080 DEBUG [Listener at localhost/46623] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37789 2023-10-01 02:01:09,081 DEBUG [Listener at localhost/46623] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37789 2023-10-01 02:01:09,087 INFO [Listener at localhost/46623] master.HMaster(444): hbase.rootdir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae, hbase.cluster.distributed=false 2023-10-01 02:01:09,146 INFO [Listener at localhost/46623] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-10-01 02:01:09,146 INFO [Listener at localhost/46623] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 02:01:09,146 INFO [Listener at localhost/46623] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-01 02:01:09,146 INFO [Listener at localhost/46623] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-01 02:01:09,146 INFO [Listener at localhost/46623] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 02:01:09,147 INFO [Listener at localhost/46623] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-01 02:01:09,151 INFO [Listener at localhost/46623] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-01 02:01:09,155 INFO [Listener at localhost/46623] ipc.NettyRpcServer(120): Bind to /136.243.18.41:45065 2023-10-01 02:01:09,157 INFO [Listener at localhost/46623] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-01 02:01:09,164 INFO [Listener at localhost/46623] mob.MobFileCache(125): MobFileCache disabled 2023-10-01 02:01:09,166 INFO [Listener at localhost/46623] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 02:01:09,168 INFO [Listener at localhost/46623] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 02:01:09,171 INFO [Listener at localhost/46623] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45065 connecting to ZooKeeper ensemble=127.0.0.1:51733 2023-10-01 02:01:09,175 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:450650x0, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-01 02:01:09,176 DEBUG [Listener at localhost/46623] zookeeper.ZKUtil(164): regionserver:450650x0, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-01 02:01:09,176 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45065-0x100ffb602650001 connected 2023-10-01 02:01:09,178 DEBUG [Listener at localhost/46623] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 02:01:09,179 DEBUG [Listener at localhost/46623] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-01 02:01:09,179 DEBUG [Listener at localhost/46623] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45065 2023-10-01 02:01:09,180 DEBUG [Listener at localhost/46623] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45065 2023-10-01 02:01:09,181 DEBUG [Listener at localhost/46623] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45065 2023-10-01 02:01:09,184 DEBUG [Listener at localhost/46623] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45065 2023-10-01 02:01:09,184 DEBUG [Listener at localhost/46623] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45065 2023-10-01 02:01:09,195 INFO [Listener at localhost/46623] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-10-01 02:01:09,195 INFO [Listener at localhost/46623] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 02:01:09,196 INFO [Listener at localhost/46623] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-01 02:01:09,196 INFO [Listener at localhost/46623] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-01 02:01:09,196 INFO [Listener at localhost/46623] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 02:01:09,197 INFO [Listener at localhost/46623] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-01 02:01:09,197 INFO [Listener at localhost/46623] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-01 02:01:09,198 INFO [Listener at localhost/46623] ipc.NettyRpcServer(120): Bind to /136.243.18.41:43503 2023-10-01 02:01:09,199 INFO [Listener at localhost/46623] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-01 02:01:09,202 INFO [Listener at localhost/46623] mob.MobFileCache(125): MobFileCache disabled 2023-10-01 02:01:09,203 INFO [Listener at localhost/46623] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 02:01:09,206 INFO [Listener at localhost/46623] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 02:01:09,209 INFO [Listener at localhost/46623] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43503 connecting to ZooKeeper ensemble=127.0.0.1:51733 2023-10-01 02:01:09,216 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:435030x0, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-01 02:01:09,217 DEBUG [Listener at localhost/46623] zookeeper.ZKUtil(164): regionserver:435030x0, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-01 02:01:09,218 DEBUG [Listener at localhost/46623] zookeeper.ZKUtil(164): regionserver:435030x0, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 02:01:09,219 DEBUG [Listener at localhost/46623] zookeeper.ZKUtil(164): regionserver:435030x0, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-01 02:01:09,221 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43503-0x100ffb602650002 connected 2023-10-01 02:01:09,222 DEBUG [Listener at localhost/46623] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43503 2023-10-01 02:01:09,222 DEBUG [Listener at localhost/46623] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43503 2023-10-01 02:01:09,224 DEBUG [Listener at localhost/46623] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43503 2023-10-01 02:01:09,225 DEBUG [Listener at localhost/46623] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43503 2023-10-01 02:01:09,229 DEBUG [Listener at localhost/46623] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43503 2023-10-01 02:01:09,240 INFO [Listener at localhost/46623] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-10-01 02:01:09,241 INFO [Listener at localhost/46623] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 02:01:09,241 INFO [Listener at localhost/46623] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-01 02:01:09,241 INFO [Listener at localhost/46623] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-01 02:01:09,241 INFO [Listener at localhost/46623] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 02:01:09,241 INFO [Listener at localhost/46623] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-01 02:01:09,241 INFO [Listener at localhost/46623] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-01 02:01:09,243 INFO [Listener at localhost/46623] ipc.NettyRpcServer(120): Bind to /136.243.18.41:44975 2023-10-01 02:01:09,244 INFO [Listener at localhost/46623] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-01 02:01:09,245 INFO [Listener at localhost/46623] mob.MobFileCache(125): MobFileCache disabled 2023-10-01 02:01:09,246 INFO [Listener at localhost/46623] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 02:01:09,247 INFO [Listener at localhost/46623] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 02:01:09,249 INFO [Listener at localhost/46623] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44975 connecting to ZooKeeper ensemble=127.0.0.1:51733 2023-10-01 02:01:09,253 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:449750x0, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-01 02:01:09,254 DEBUG [Listener at localhost/46623] zookeeper.ZKUtil(164): regionserver:449750x0, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-01 02:01:09,255 DEBUG [Listener at localhost/46623] zookeeper.ZKUtil(164): regionserver:449750x0, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 02:01:09,255 DEBUG [Listener at localhost/46623] zookeeper.ZKUtil(164): regionserver:449750x0, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-01 02:01:09,257 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44975-0x100ffb602650003 connected 2023-10-01 02:01:09,258 DEBUG [Listener at localhost/46623] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44975 2023-10-01 02:01:09,261 DEBUG [Listener at localhost/46623] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44975 2023-10-01 02:01:09,261 DEBUG [Listener at localhost/46623] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44975 2023-10-01 02:01:09,267 DEBUG [Listener at localhost/46623] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44975 2023-10-01 02:01:09,269 DEBUG [Listener at localhost/46623] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44975 2023-10-01 02:01:09,271 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase17.apache.org,37789,1696125668050 2023-10-01 02:01:09,280 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-01 02:01:09,281 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase17.apache.org,37789,1696125668050 2023-10-01 02:01:09,300 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-01 02:01:09,300 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-01 02:01:09,300 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-01 02:01:09,300 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-01 02:01:09,300 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 02:01:09,302 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-01 02:01:09,304 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase17.apache.org,37789,1696125668050 from backup master directory 2023-10-01 02:01:09,304 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-01 02:01:09,308 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase17.apache.org,37789,1696125668050 2023-10-01 02:01:09,308 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-01 02:01:09,309 WARN [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-01 02:01:09,310 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase17.apache.org,37789,1696125668050 2023-10-01 02:01:09,314 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-01 02:01:09,316 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-01 02:01:09,434 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/hbase.id with ID: 53c58d9b-4ca9-45c4-80a8-cccce17670bb 2023-10-01 02:01:09,481 INFO [master/jenkins-hbase17:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 02:01:09,497 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 02:01:09,552 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x591e1af1 to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:01:09,586 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ee3ecea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:01:09,610 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-01 02:01:09,612 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-01 02:01:09,629 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-01 02:01:09,629 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-01 02:01:09,631 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-01 02:01:09,635 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-01 02:01:09,637 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-01 02:01:09,671 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/MasterData/data/master/store-tmp 2023-10-01 02:01:09,712 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:01:09,713 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-01 02:01:09,713 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 02:01:09,713 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 02:01:09,713 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-01 02:01:09,713 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 02:01:09,713 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 02:01:09,713 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-01 02:01:09,716 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/MasterData/WALs/jenkins-hbase17.apache.org,37789,1696125668050 2023-10-01 02:01:09,740 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C37789%2C1696125668050, suffix=, logDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/MasterData/WALs/jenkins-hbase17.apache.org,37789,1696125668050, archiveDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/MasterData/oldWALs, maxLogs=10 2023-10-01 02:01:09,811 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33679,DS-b8127a02-dbf7-4678-a303-9b5465c96be0,DISK] 2023-10-01 02:01:09,811 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42751,DS-652e8f7e-14a8-4981-b8c3-302afb26a1eb,DISK] 2023-10-01 02:01:09,813 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42031,DS-3042c49a-6f70-461c-b104-93fc378232a4,DISK] 2023-10-01 02:01:09,822 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-01 02:01:09,898 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/MasterData/WALs/jenkins-hbase17.apache.org,37789,1696125668050/jenkins-hbase17.apache.org%2C37789%2C1696125668050.1696125669751 2023-10-01 02:01:09,899 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42751,DS-652e8f7e-14a8-4981-b8c3-302afb26a1eb,DISK], DatanodeInfoWithStorage[127.0.0.1:42031,DS-3042c49a-6f70-461c-b104-93fc378232a4,DISK], DatanodeInfoWithStorage[127.0.0.1:33679,DS-b8127a02-dbf7-4678-a303-9b5465c96be0,DISK]] 2023-10-01 02:01:09,900 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-01 02:01:09,900 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:01:09,903 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-01 02:01:09,905 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-01 02:01:09,965 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-01 02:01:09,972 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-01 02:01:09,999 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-01 02:01:10,010 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 02:01:10,017 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-01 02:01:10,019 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-01 02:01:10,035 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-01 02:01:10,039 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 02:01:10,040 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71425394, jitterRate=0.06432130932807922}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 02:01:10,041 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-01 02:01:10,042 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-01 02:01:10,062 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-01 02:01:10,063 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-01 02:01:10,065 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-01 02:01:10,068 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-01 02:01:10,103 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 35 msec 2023-10-01 02:01:10,103 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-01 02:01:10,133 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-01 02:01:10,140 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-01 02:01:10,165 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-01 02:01:10,170 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-01 02:01:10,171 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-01 02:01:10,177 INFO [master/jenkins-hbase17:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-01 02:01:10,181 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-01 02:01:10,183 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 02:01:10,185 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-01 02:01:10,185 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-01 02:01:10,199 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-01 02:01:10,203 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-01 02:01:10,203 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-01 02:01:10,203 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-01 02:01:10,203 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-01 02:01:10,203 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 02:01:10,204 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase17.apache.org,37789,1696125668050, sessionid=0x100ffb602650000, setting cluster-up flag (Was=false) 2023-10-01 02:01:10,222 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 02:01:10,226 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-01 02:01:10,227 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,37789,1696125668050 2023-10-01 02:01:10,232 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 02:01:10,236 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-01 02:01:10,237 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,37789,1696125668050 2023-10-01 02:01:10,241 WARN [master/jenkins-hbase17:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp 2023-10-01 02:01:10,274 INFO [RS:0;jenkins-hbase17:45065] regionserver.HRegionServer(951): ClusterId : 53c58d9b-4ca9-45c4-80a8-cccce17670bb 2023-10-01 02:01:10,276 INFO [RS:2;jenkins-hbase17:44975] regionserver.HRegionServer(951): ClusterId : 53c58d9b-4ca9-45c4-80a8-cccce17670bb 2023-10-01 02:01:10,277 INFO [RS:1;jenkins-hbase17:43503] regionserver.HRegionServer(951): ClusterId : 53c58d9b-4ca9-45c4-80a8-cccce17670bb 2023-10-01 02:01:10,281 DEBUG [RS:2;jenkins-hbase17:44975] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-01 02:01:10,281 DEBUG [RS:1;jenkins-hbase17:43503] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-01 02:01:10,281 DEBUG [RS:0;jenkins-hbase17:45065] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-01 02:01:10,288 DEBUG [RS:0;jenkins-hbase17:45065] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-01 02:01:10,288 DEBUG [RS:0;jenkins-hbase17:45065] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-01 02:01:10,288 DEBUG [RS:1;jenkins-hbase17:43503] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-01 02:01:10,288 DEBUG [RS:1;jenkins-hbase17:43503] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-01 02:01:10,288 DEBUG [RS:2;jenkins-hbase17:44975] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-01 02:01:10,289 DEBUG [RS:2;jenkins-hbase17:44975] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-01 02:01:10,292 DEBUG [RS:0;jenkins-hbase17:45065] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-01 02:01:10,292 DEBUG [RS:1;jenkins-hbase17:43503] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-01 02:01:10,297 DEBUG [RS:2;jenkins-hbase17:44975] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-01 02:01:10,304 DEBUG [RS:0;jenkins-hbase17:45065] zookeeper.ReadOnlyZKClient(139): Connect 0x6cbc9d46 to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:01:10,305 DEBUG [RS:1;jenkins-hbase17:43503] zookeeper.ReadOnlyZKClient(139): Connect 0x0c2b27eb to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:01:10,305 DEBUG [RS:2;jenkins-hbase17:44975] zookeeper.ReadOnlyZKClient(139): Connect 0x13fdb154 to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:01:10,321 DEBUG [RS:0;jenkins-hbase17:45065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@627b6ea1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:01:10,322 DEBUG [RS:0;jenkins-hbase17:45065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6644f636, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-10-01 02:01:10,351 DEBUG [RS:2;jenkins-hbase17:44975] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d3a4d5b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:01:10,352 DEBUG [RS:2;jenkins-hbase17:44975] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1905da24, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-10-01 02:01:10,353 DEBUG [RS:1;jenkins-hbase17:43503] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ecc81e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:01:10,353 DEBUG [RS:1;jenkins-hbase17:43503] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d34c9b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-10-01 02:01:10,377 DEBUG [RS:0;jenkins-hbase17:45065] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase17:45065 2023-10-01 02:01:10,382 DEBUG [RS:2;jenkins-hbase17:44975] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase17:44975 2023-10-01 02:01:10,388 DEBUG [RS:1;jenkins-hbase17:43503] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase17:43503 2023-10-01 02:01:10,393 INFO [RS:0;jenkins-hbase17:45065] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-01 02:01:10,397 INFO [RS:2;jenkins-hbase17:44975] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-01 02:01:10,393 INFO [RS:1;jenkins-hbase17:43503] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-01 02:01:10,398 INFO [RS:2;jenkins-hbase17:44975] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-01 02:01:10,397 INFO [RS:0;jenkins-hbase17:45065] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-01 02:01:10,398 INFO [RS:1;jenkins-hbase17:43503] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-01 02:01:10,408 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-10-01 02:01:10,408 DEBUG [RS:0;jenkins-hbase17:45065] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-01 02:01:10,408 DEBUG [RS:1;jenkins-hbase17:43503] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-01 02:01:10,408 DEBUG [RS:2;jenkins-hbase17:44975] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-01 02:01:10,411 INFO [RS:1;jenkins-hbase17:43503] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 02:01:10,411 INFO [RS:0;jenkins-hbase17:45065] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 02:01:10,411 INFO [master/jenkins-hbase17:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 02:01:10,411 INFO [RS:2;jenkins-hbase17:44975] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 02:01:10,412 DEBUG [RS:2;jenkins-hbase17:44975] regionserver.HRegionServer(1022): About to register with Master. 2023-10-01 02:01:10,411 DEBUG [RS:0;jenkins-hbase17:45065] regionserver.HRegionServer(1022): About to register with Master. 2023-10-01 02:01:10,411 DEBUG [RS:1;jenkins-hbase17:43503] regionserver.HRegionServer(1022): About to register with Master. 2023-10-01 02:01:10,412 INFO [master/jenkins-hbase17:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-10-01 02:01:10,415 INFO [RS:1;jenkins-hbase17:43503] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,37789,1696125668050 with isa=jenkins-hbase17.apache.org/136.243.18.41:43503, startcode=1696125669195 2023-10-01 02:01:10,415 INFO [RS:2;jenkins-hbase17:44975] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,37789,1696125668050 with isa=jenkins-hbase17.apache.org/136.243.18.41:44975, startcode=1696125669240 2023-10-01 02:01:10,415 INFO [RS:0;jenkins-hbase17:45065] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,37789,1696125668050 with isa=jenkins-hbase17.apache.org/136.243.18.41:45065, startcode=1696125669145 2023-10-01 02:01:10,433 DEBUG [RS:1;jenkins-hbase17:43503] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-01 02:01:10,433 DEBUG [RS:0;jenkins-hbase17:45065] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-01 02:01:10,433 DEBUG [RS:2;jenkins-hbase17:44975] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-01 02:01:10,492 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42255, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-10-01 02:01:10,492 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34623, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-10-01 02:01:10,492 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:58823, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-01 02:01:10,495 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-01 02:01:10,502 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37789] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-01 02:01:10,509 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-10-01 02:01:10,509 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-10-01 02:01:10,509 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-10-01 02:01:10,509 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-10-01 02:01:10,509 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase17:0, corePoolSize=10, maxPoolSize=10 2023-10-01 02:01:10,509 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,510 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-10-01 02:01:10,510 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,512 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37789] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-01 02:01:10,512 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1696125700512 2023-10-01 02:01:10,513 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37789] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-01 02:01:10,517 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-01 02:01:10,523 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-01 02:01:10,524 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-01 02:01:10,529 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-01 02:01:10,530 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-01 02:01:10,534 DEBUG [RS:2;jenkins-hbase17:44975] regionserver.HRegionServer(2830): Master is not running yet 2023-10-01 02:01:10,534 DEBUG [RS:1;jenkins-hbase17:43503] regionserver.HRegionServer(2830): Master is not running yet 2023-10-01 02:01:10,534 WARN [RS:2;jenkins-hbase17:44975] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-01 02:01:10,534 DEBUG [RS:0;jenkins-hbase17:45065] regionserver.HRegionServer(2830): Master is not running yet 2023-10-01 02:01:10,534 WARN [RS:1;jenkins-hbase17:43503] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-01 02:01:10,535 WARN [RS:0;jenkins-hbase17:45065] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-01 02:01:10,538 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-01 02:01:10,539 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-01 02:01:10,540 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-01 02:01:10,540 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-01 02:01:10,544 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-01 02:01:10,546 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-01 02:01:10,548 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-01 02:01:10,549 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-01 02:01:10,553 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-01 02:01:10,554 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-01 02:01:10,561 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1696125670560,5,FailOnTimeoutGroup] 2023-10-01 02:01:10,562 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1696125670561,5,FailOnTimeoutGroup] 2023-10-01 02:01:10,563 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-01 02:01:10,563 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-01 02:01:10,565 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-01 02:01:10,565 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-01 02:01:10,590 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-01 02:01:10,591 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-01 02:01:10,592 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae 2023-10-01 02:01:10,618 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:01:10,621 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-01 02:01:10,624 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/1588230740/info 2023-10-01 02:01:10,625 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-01 02:01:10,626 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 02:01:10,626 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-01 02:01:10,630 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/1588230740/rep_barrier 2023-10-01 02:01:10,631 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-01 02:01:10,632 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 02:01:10,632 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-01 02:01:10,635 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/1588230740/table 2023-10-01 02:01:10,635 INFO [RS:2;jenkins-hbase17:44975] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,37789,1696125668050 with isa=jenkins-hbase17.apache.org/136.243.18.41:44975, startcode=1696125669240 2023-10-01 02:01:10,637 INFO [RS:1;jenkins-hbase17:43503] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,37789,1696125668050 with isa=jenkins-hbase17.apache.org/136.243.18.41:43503, startcode=1696125669195 2023-10-01 02:01:10,637 INFO [RS:0;jenkins-hbase17:45065] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,37789,1696125668050 with isa=jenkins-hbase17.apache.org/136.243.18.41:45065, startcode=1696125669145 2023-10-01 02:01:10,638 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-01 02:01:10,640 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 02:01:10,643 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/1588230740 2023-10-01 02:01:10,645 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37789] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:10,645 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/1588230740 2023-10-01 02:01:10,650 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-01 02:01:10,650 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37789] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:10,651 DEBUG [RS:2;jenkins-hbase17:44975] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae 2023-10-01 02:01:10,652 DEBUG [RS:2;jenkins-hbase17:44975] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33385 2023-10-01 02:01:10,652 DEBUG [RS:2;jenkins-hbase17:44975] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-01 02:01:10,652 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37789] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:10,655 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-01 02:01:10,663 DEBUG [RS:0;jenkins-hbase17:45065] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae 2023-10-01 02:01:10,663 DEBUG [RS:1;jenkins-hbase17:43503] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae 2023-10-01 02:01:10,663 DEBUG [RS:0;jenkins-hbase17:45065] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33385 2023-10-01 02:01:10,663 DEBUG [RS:0;jenkins-hbase17:45065] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-01 02:01:10,663 DEBUG [RS:1;jenkins-hbase17:43503] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33385 2023-10-01 02:01:10,664 DEBUG [RS:1;jenkins-hbase17:43503] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-01 02:01:10,664 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 02:01:10,668 DEBUG [RS:2;jenkins-hbase17:44975] zookeeper.ZKUtil(162): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:10,668 WARN [RS:2;jenkins-hbase17:44975] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-01 02:01:10,668 INFO [RS:2;jenkins-hbase17:44975] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-01 02:01:10,668 DEBUG [RS:1;jenkins-hbase17:43503] zookeeper.ZKUtil(162): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:10,668 DEBUG [RS:2;jenkins-hbase17:44975] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/WALs/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:10,669 DEBUG [RS:0;jenkins-hbase17:45065] zookeeper.ZKUtil(162): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:10,670 WARN [RS:0;jenkins-hbase17:45065] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-01 02:01:10,670 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,43503,1696125669195] 2023-10-01 02:01:10,670 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,45065,1696125669145] 2023-10-01 02:01:10,671 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,44975,1696125669240] 2023-10-01 02:01:10,669 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 02:01:10,669 WARN [RS:1;jenkins-hbase17:43503] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-01 02:01:10,670 INFO [RS:0;jenkins-hbase17:45065] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-01 02:01:10,671 INFO [RS:1;jenkins-hbase17:43503] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-01 02:01:10,671 DEBUG [RS:0;jenkins-hbase17:45065] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/WALs/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:10,671 DEBUG [RS:1;jenkins-hbase17:43503] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/WALs/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:10,672 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60258435, jitterRate=-0.1020793467760086}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-01 02:01:10,673 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-01 02:01:10,673 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-01 02:01:10,673 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-01 02:01:10,673 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-01 02:01:10,673 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-01 02:01:10,673 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-01 02:01:10,681 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-01 02:01:10,681 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-01 02:01:10,699 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-01 02:01:10,699 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-01 02:01:10,701 DEBUG [RS:1;jenkins-hbase17:43503] zookeeper.ZKUtil(162): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:10,701 DEBUG [RS:2;jenkins-hbase17:44975] zookeeper.ZKUtil(162): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:10,701 DEBUG [RS:0;jenkins-hbase17:45065] zookeeper.ZKUtil(162): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:10,702 DEBUG [RS:2;jenkins-hbase17:44975] zookeeper.ZKUtil(162): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:10,702 DEBUG [RS:0;jenkins-hbase17:45065] zookeeper.ZKUtil(162): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:10,702 DEBUG [RS:1;jenkins-hbase17:43503] zookeeper.ZKUtil(162): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:10,702 DEBUG [RS:2;jenkins-hbase17:44975] zookeeper.ZKUtil(162): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:10,702 DEBUG [RS:0;jenkins-hbase17:45065] zookeeper.ZKUtil(162): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:10,702 DEBUG [RS:1;jenkins-hbase17:43503] zookeeper.ZKUtil(162): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:10,710 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-01 02:01:10,714 DEBUG [RS:2;jenkins-hbase17:44975] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-01 02:01:10,714 DEBUG [RS:1;jenkins-hbase17:43503] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-01 02:01:10,714 DEBUG [RS:0;jenkins-hbase17:45065] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-01 02:01:10,724 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-01 02:01:10,726 INFO [RS:1;jenkins-hbase17:43503] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-01 02:01:10,726 INFO [RS:2;jenkins-hbase17:44975] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-01 02:01:10,734 INFO [RS:0;jenkins-hbase17:45065] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-01 02:01:10,735 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-01 02:01:10,751 INFO [RS:0;jenkins-hbase17:45065] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-01 02:01:10,751 INFO [RS:2;jenkins-hbase17:44975] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-01 02:01:10,754 INFO [RS:1;jenkins-hbase17:43503] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-01 02:01:10,756 INFO [RS:2;jenkins-hbase17:44975] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-01 02:01:10,756 INFO [RS:0;jenkins-hbase17:45065] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-01 02:01:10,756 INFO [RS:2;jenkins-hbase17:44975] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 02:01:10,756 INFO [RS:1;jenkins-hbase17:43503] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-01 02:01:10,757 INFO [RS:0;jenkins-hbase17:45065] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 02:01:10,757 INFO [RS:1;jenkins-hbase17:43503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 02:01:10,758 INFO [RS:2;jenkins-hbase17:44975] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-01 02:01:10,758 INFO [RS:0;jenkins-hbase17:45065] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-01 02:01:10,758 INFO [RS:1;jenkins-hbase17:43503] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-01 02:01:10,767 INFO [RS:0;jenkins-hbase17:45065] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-01 02:01:10,767 INFO [RS:2;jenkins-hbase17:44975] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-01 02:01:10,767 INFO [RS:1;jenkins-hbase17:43503] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-01 02:01:10,767 DEBUG [RS:0;jenkins-hbase17:45065] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,767 DEBUG [RS:2;jenkins-hbase17:44975] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,767 DEBUG [RS:1;jenkins-hbase17:43503] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,768 DEBUG [RS:2;jenkins-hbase17:44975] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,767 DEBUG [RS:0;jenkins-hbase17:45065] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,768 DEBUG [RS:1;jenkins-hbase17:43503] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,768 DEBUG [RS:0;jenkins-hbase17:45065] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,768 DEBUG [RS:2;jenkins-hbase17:44975] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,768 DEBUG [RS:0;jenkins-hbase17:45065] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,768 DEBUG [RS:1;jenkins-hbase17:43503] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,768 DEBUG [RS:0;jenkins-hbase17:45065] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,768 DEBUG [RS:2;jenkins-hbase17:44975] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,768 DEBUG [RS:0;jenkins-hbase17:45065] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-10-01 02:01:10,768 DEBUG [RS:1;jenkins-hbase17:43503] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,768 DEBUG [RS:0;jenkins-hbase17:45065] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,768 DEBUG [RS:2;jenkins-hbase17:44975] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,769 DEBUG [RS:0;jenkins-hbase17:45065] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,769 DEBUG [RS:1;jenkins-hbase17:43503] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,769 DEBUG [RS:0;jenkins-hbase17:45065] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,769 DEBUG [RS:2;jenkins-hbase17:44975] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-10-01 02:01:10,769 DEBUG [RS:0;jenkins-hbase17:45065] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,769 DEBUG [RS:1;jenkins-hbase17:43503] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-10-01 02:01:10,769 DEBUG [RS:2;jenkins-hbase17:44975] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,769 DEBUG [RS:1;jenkins-hbase17:43503] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,769 DEBUG [RS:2;jenkins-hbase17:44975] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,769 DEBUG [RS:1;jenkins-hbase17:43503] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,769 DEBUG [RS:2;jenkins-hbase17:44975] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,769 DEBUG [RS:1;jenkins-hbase17:43503] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,769 DEBUG [RS:2;jenkins-hbase17:44975] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,769 DEBUG [RS:1;jenkins-hbase17:43503] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-10-01 02:01:10,780 INFO [RS:1;jenkins-hbase17:43503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 02:01:10,780 INFO [RS:2;jenkins-hbase17:44975] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 02:01:10,780 INFO [RS:0;jenkins-hbase17:45065] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 02:01:10,780 INFO [RS:2;jenkins-hbase17:44975] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 02:01:10,780 INFO [RS:1;jenkins-hbase17:43503] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 02:01:10,780 INFO [RS:2;jenkins-hbase17:44975] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-01 02:01:10,780 INFO [RS:1;jenkins-hbase17:43503] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-01 02:01:10,780 INFO [RS:0;jenkins-hbase17:45065] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 02:01:10,781 INFO [RS:0;jenkins-hbase17:45065] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-01 02:01:10,799 INFO [RS:2;jenkins-hbase17:44975] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-01 02:01:10,799 INFO [RS:1;jenkins-hbase17:43503] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-01 02:01:10,799 INFO [RS:0;jenkins-hbase17:45065] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-01 02:01:10,803 INFO [RS:2;jenkins-hbase17:44975] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,44975,1696125669240-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 02:01:10,803 INFO [RS:0;jenkins-hbase17:45065] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,45065,1696125669145-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 02:01:10,807 INFO [RS:1;jenkins-hbase17:43503] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,43503,1696125669195-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 02:01:10,832 INFO [RS:2;jenkins-hbase17:44975] regionserver.Replication(203): jenkins-hbase17.apache.org,44975,1696125669240 started 2023-10-01 02:01:10,832 INFO [RS:2;jenkins-hbase17:44975] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,44975,1696125669240, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:44975, sessionid=0x100ffb602650003 2023-10-01 02:01:10,833 DEBUG [RS:2;jenkins-hbase17:44975] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-01 02:01:10,833 INFO [RS:0;jenkins-hbase17:45065] regionserver.Replication(203): jenkins-hbase17.apache.org,45065,1696125669145 started 2023-10-01 02:01:10,833 DEBUG [RS:2;jenkins-hbase17:44975] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:10,833 INFO [RS:0;jenkins-hbase17:45065] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,45065,1696125669145, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:45065, sessionid=0x100ffb602650001 2023-10-01 02:01:10,833 INFO [RS:1;jenkins-hbase17:43503] regionserver.Replication(203): jenkins-hbase17.apache.org,43503,1696125669195 started 2023-10-01 02:01:10,833 DEBUG [RS:2;jenkins-hbase17:44975] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,44975,1696125669240' 2023-10-01 02:01:10,833 INFO [RS:1;jenkins-hbase17:43503] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,43503,1696125669195, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:43503, sessionid=0x100ffb602650002 2023-10-01 02:01:10,833 DEBUG [RS:0;jenkins-hbase17:45065] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-01 02:01:10,834 DEBUG [RS:1;jenkins-hbase17:43503] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-01 02:01:10,834 DEBUG [RS:0;jenkins-hbase17:45065] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:10,833 DEBUG [RS:2;jenkins-hbase17:44975] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-01 02:01:10,834 DEBUG [RS:0;jenkins-hbase17:45065] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,45065,1696125669145' 2023-10-01 02:01:10,835 DEBUG [RS:0;jenkins-hbase17:45065] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-01 02:01:10,834 DEBUG [RS:1;jenkins-hbase17:43503] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:10,837 DEBUG [RS:1;jenkins-hbase17:43503] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,43503,1696125669195' 2023-10-01 02:01:10,837 DEBUG [RS:1;jenkins-hbase17:43503] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-01 02:01:10,845 DEBUG [RS:0;jenkins-hbase17:45065] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-01 02:01:10,845 DEBUG [RS:1;jenkins-hbase17:43503] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-01 02:01:10,845 DEBUG [RS:2;jenkins-hbase17:44975] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-01 02:01:10,846 DEBUG [RS:0;jenkins-hbase17:45065] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-01 02:01:10,846 DEBUG [RS:0;jenkins-hbase17:45065] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-01 02:01:10,846 DEBUG [RS:1;jenkins-hbase17:43503] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-01 02:01:10,846 DEBUG [RS:0;jenkins-hbase17:45065] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:10,846 DEBUG [RS:2;jenkins-hbase17:44975] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-01 02:01:10,846 DEBUG [RS:0;jenkins-hbase17:45065] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,45065,1696125669145' 2023-10-01 02:01:10,846 DEBUG [RS:1;jenkins-hbase17:43503] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-01 02:01:10,846 DEBUG [RS:0;jenkins-hbase17:45065] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:10,846 DEBUG [RS:2;jenkins-hbase17:44975] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-01 02:01:10,847 DEBUG [RS:1;jenkins-hbase17:43503] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:10,847 DEBUG [RS:2;jenkins-hbase17:44975] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:10,847 DEBUG [RS:1;jenkins-hbase17:43503] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,43503,1696125669195' 2023-10-01 02:01:10,847 DEBUG [RS:1;jenkins-hbase17:43503] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:10,848 DEBUG [RS:0;jenkins-hbase17:45065] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:10,847 DEBUG [RS:2;jenkins-hbase17:44975] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,44975,1696125669240' 2023-10-01 02:01:10,848 DEBUG [RS:2;jenkins-hbase17:44975] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:10,848 DEBUG [RS:1;jenkins-hbase17:43503] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:10,848 DEBUG [RS:2;jenkins-hbase17:44975] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:10,848 DEBUG [RS:1;jenkins-hbase17:43503] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-01 02:01:10,849 INFO [RS:1;jenkins-hbase17:43503] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-01 02:01:10,849 DEBUG [RS:2;jenkins-hbase17:44975] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-01 02:01:10,849 INFO [RS:1;jenkins-hbase17:43503] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-01 02:01:10,849 DEBUG [RS:0;jenkins-hbase17:45065] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-01 02:01:10,849 INFO [RS:2;jenkins-hbase17:44975] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-01 02:01:10,849 INFO [RS:0;jenkins-hbase17:45065] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-01 02:01:10,849 INFO [RS:2;jenkins-hbase17:44975] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-01 02:01:10,850 INFO [RS:0;jenkins-hbase17:45065] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-01 02:01:10,888 DEBUG [jenkins-hbase17:37789] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-10-01 02:01:10,893 DEBUG [jenkins-hbase17:37789] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-10-01 02:01:10,900 DEBUG [jenkins-hbase17:37789] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 02:01:10,900 DEBUG [jenkins-hbase17:37789] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 02:01:10,900 DEBUG [jenkins-hbase17:37789] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 02:01:10,900 DEBUG [jenkins-hbase17:37789] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 02:01:10,903 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,43503,1696125669195, state=OPENING 2023-10-01 02:01:10,910 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-01 02:01:10,911 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 02:01:10,912 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-01 02:01:10,916 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,43503,1696125669195}] 2023-10-01 02:01:10,962 INFO [RS:2;jenkins-hbase17:44975] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C44975%2C1696125669240, suffix=, logDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/WALs/jenkins-hbase17.apache.org,44975,1696125669240, archiveDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/oldWALs, maxLogs=32 2023-10-01 02:01:10,962 INFO [RS:0;jenkins-hbase17:45065] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C45065%2C1696125669145, suffix=, logDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/WALs/jenkins-hbase17.apache.org,45065,1696125669145, archiveDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/oldWALs, maxLogs=32 2023-10-01 02:01:10,973 INFO [RS:1;jenkins-hbase17:43503] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C43503%2C1696125669195, suffix=, logDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/WALs/jenkins-hbase17.apache.org,43503,1696125669195, archiveDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/oldWALs, maxLogs=32 2023-10-01 02:01:10,992 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33679,DS-b8127a02-dbf7-4678-a303-9b5465c96be0,DISK] 2023-10-01 02:01:10,993 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42031,DS-3042c49a-6f70-461c-b104-93fc378232a4,DISK] 2023-10-01 02:01:10,993 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42751,DS-652e8f7e-14a8-4981-b8c3-302afb26a1eb,DISK] 2023-10-01 02:01:11,016 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33679,DS-b8127a02-dbf7-4678-a303-9b5465c96be0,DISK] 2023-10-01 02:01:11,018 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42751,DS-652e8f7e-14a8-4981-b8c3-302afb26a1eb,DISK] 2023-10-01 02:01:11,018 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42031,DS-3042c49a-6f70-461c-b104-93fc378232a4,DISK] 2023-10-01 02:01:11,022 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42031,DS-3042c49a-6f70-461c-b104-93fc378232a4,DISK] 2023-10-01 02:01:11,024 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42751,DS-652e8f7e-14a8-4981-b8c3-302afb26a1eb,DISK] 2023-10-01 02:01:11,024 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33679,DS-b8127a02-dbf7-4678-a303-9b5465c96be0,DISK] 2023-10-01 02:01:11,026 INFO [RS:2;jenkins-hbase17:44975] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/WALs/jenkins-hbase17.apache.org,44975,1696125669240/jenkins-hbase17.apache.org%2C44975%2C1696125669240.1696125670972 2023-10-01 02:01:11,027 DEBUG [RS:2;jenkins-hbase17:44975] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33679,DS-b8127a02-dbf7-4678-a303-9b5465c96be0,DISK], DatanodeInfoWithStorage[127.0.0.1:42031,DS-3042c49a-6f70-461c-b104-93fc378232a4,DISK], DatanodeInfoWithStorage[127.0.0.1:42751,DS-652e8f7e-14a8-4981-b8c3-302afb26a1eb,DISK]] 2023-10-01 02:01:11,036 INFO [RS:1;jenkins-hbase17:43503] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/WALs/jenkins-hbase17.apache.org,43503,1696125669195/jenkins-hbase17.apache.org%2C43503%2C1696125669195.1696125670975 2023-10-01 02:01:11,036 INFO [RS:0;jenkins-hbase17:45065] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/WALs/jenkins-hbase17.apache.org,45065,1696125669145/jenkins-hbase17.apache.org%2C45065%2C1696125669145.1696125670974 2023-10-01 02:01:11,036 DEBUG [RS:1;jenkins-hbase17:43503] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42031,DS-3042c49a-6f70-461c-b104-93fc378232a4,DISK], DatanodeInfoWithStorage[127.0.0.1:33679,DS-b8127a02-dbf7-4678-a303-9b5465c96be0,DISK], DatanodeInfoWithStorage[127.0.0.1:42751,DS-652e8f7e-14a8-4981-b8c3-302afb26a1eb,DISK]] 2023-10-01 02:01:11,036 DEBUG [RS:0;jenkins-hbase17:45065] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33679,DS-b8127a02-dbf7-4678-a303-9b5465c96be0,DISK], DatanodeInfoWithStorage[127.0.0.1:42031,DS-3042c49a-6f70-461c-b104-93fc378232a4,DISK], DatanodeInfoWithStorage[127.0.0.1:42751,DS-652e8f7e-14a8-4981-b8c3-302afb26a1eb,DISK]] 2023-10-01 02:01:11,100 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:11,102 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 02:01:11,105 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:41784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 02:01:11,117 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-01 02:01:11,118 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-01 02:01:11,122 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C43503%2C1696125669195.meta, suffix=.meta, logDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/WALs/jenkins-hbase17.apache.org,43503,1696125669195, archiveDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/oldWALs, maxLogs=32 2023-10-01 02:01:11,141 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33679,DS-b8127a02-dbf7-4678-a303-9b5465c96be0,DISK] 2023-10-01 02:01:11,143 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42751,DS-652e8f7e-14a8-4981-b8c3-302afb26a1eb,DISK] 2023-10-01 02:01:11,143 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42031,DS-3042c49a-6f70-461c-b104-93fc378232a4,DISK] 2023-10-01 02:01:11,154 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/WALs/jenkins-hbase17.apache.org,43503,1696125669195/jenkins-hbase17.apache.org%2C43503%2C1696125669195.meta.1696125671124.meta 2023-10-01 02:01:11,156 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33679,DS-b8127a02-dbf7-4678-a303-9b5465c96be0,DISK], DatanodeInfoWithStorage[127.0.0.1:42751,DS-652e8f7e-14a8-4981-b8c3-302afb26a1eb,DISK], DatanodeInfoWithStorage[127.0.0.1:42031,DS-3042c49a-6f70-461c-b104-93fc378232a4,DISK]] 2023-10-01 02:01:11,157 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-01 02:01:11,158 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-10-01 02:01:11,160 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 02:01:11,160 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-01 02:01:11,162 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-01 02:01:11,164 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-01 02:01:11,175 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-01 02:01:11,175 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:01:11,175 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-01 02:01:11,176 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-01 02:01:11,179 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-01 02:01:11,181 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/1588230740/info 2023-10-01 02:01:11,181 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/1588230740/info 2023-10-01 02:01:11,181 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-01 02:01:11,182 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 02:01:11,182 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-01 02:01:11,184 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/1588230740/rep_barrier 2023-10-01 02:01:11,184 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/1588230740/rep_barrier 2023-10-01 02:01:11,185 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-01 02:01:11,186 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 02:01:11,186 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-01 02:01:11,187 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/1588230740/table 2023-10-01 02:01:11,188 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/1588230740/table 2023-10-01 02:01:11,188 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-01 02:01:11,189 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 02:01:11,192 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/1588230740 2023-10-01 02:01:11,204 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/1588230740 2023-10-01 02:01:11,210 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-01 02:01:11,213 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-01 02:01:11,214 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71888005, jitterRate=0.07121475040912628}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-01 02:01:11,217 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-01 02:01:11,229 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1696125671093 2023-10-01 02:01:11,248 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-01 02:01:11,249 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-01 02:01:11,249 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,43503,1696125669195, state=OPEN 2023-10-01 02:01:11,252 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-01 02:01:11,252 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-01 02:01:11,263 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-01 02:01:11,264 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,43503,1696125669195 in 336 msec 2023-10-01 02:01:11,271 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-01 02:01:11,271 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 555 msec 2023-10-01 02:01:11,279 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 855 msec 2023-10-01 02:01:11,280 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1696125671279, completionTime=-1 2023-10-01 02:01:11,280 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-10-01 02:01:11,280 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-10-01 02:01:11,347 DEBUG [hconnection-0x74c15b32-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:01:11,352 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:41788, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:01:11,407 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-10-01 02:01:11,407 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1696125731407 2023-10-01 02:01:11,407 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1696125791407 2023-10-01 02:01:11,407 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 127 msec 2023-10-01 02:01:11,430 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,37789,1696125668050-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 02:01:11,430 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,37789,1696125668050-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-01 02:01:11,431 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,37789,1696125668050-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-01 02:01:11,432 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase17:37789, period=300000, unit=MILLISECONDS is enabled. 2023-10-01 02:01:11,433 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-01 02:01:11,441 DEBUG [master/jenkins-hbase17:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-01 02:01:11,449 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-01 02:01:11,451 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-01 02:01:11,464 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-01 02:01:11,467 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 02:01:11,471 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 02:01:11,503 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/hbase/namespace/6d61171d7943c631da3d431e495162f5 2023-10-01 02:01:11,506 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/hbase/namespace/6d61171d7943c631da3d431e495162f5 empty. 2023-10-01 02:01:11,507 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/hbase/namespace/6d61171d7943c631da3d431e495162f5 2023-10-01 02:01:11,507 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-01 02:01:11,560 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-01 02:01:11,563 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6d61171d7943c631da3d431e495162f5, NAME => 'hbase:namespace,,1696125671450.6d61171d7943c631da3d431e495162f5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp 2023-10-01 02:01:11,589 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696125671450.6d61171d7943c631da3d431e495162f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:01:11,589 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 6d61171d7943c631da3d431e495162f5, disabling compactions & flushes 2023-10-01 02:01:11,589 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696125671450.6d61171d7943c631da3d431e495162f5. 2023-10-01 02:01:11,589 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696125671450.6d61171d7943c631da3d431e495162f5. 2023-10-01 02:01:11,589 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696125671450.6d61171d7943c631da3d431e495162f5. after waiting 0 ms 2023-10-01 02:01:11,589 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696125671450.6d61171d7943c631da3d431e495162f5. 2023-10-01 02:01:11,589 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696125671450.6d61171d7943c631da3d431e495162f5. 2023-10-01 02:01:11,589 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 6d61171d7943c631da3d431e495162f5: 2023-10-01 02:01:11,595 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 02:01:11,613 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1696125671450.6d61171d7943c631da3d431e495162f5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696125671599"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125671599"}]},"ts":"1696125671599"} 2023-10-01 02:01:11,638 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-01 02:01:11,640 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 02:01:11,644 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125671641"}]},"ts":"1696125671641"} 2023-10-01 02:01:11,649 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-01 02:01:11,653 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-10-01 02:01:11,654 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 02:01:11,654 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 02:01:11,654 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 02:01:11,654 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 02:01:11,656 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6d61171d7943c631da3d431e495162f5, ASSIGN}] 2023-10-01 02:01:11,660 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6d61171d7943c631da3d431e495162f5, ASSIGN 2023-10-01 02:01:11,662 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=6d61171d7943c631da3d431e495162f5, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,45065,1696125669145; forceNewPlan=false, retain=false 2023-10-01 02:01:11,815 INFO [jenkins-hbase17:37789] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-01 02:01:11,816 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6d61171d7943c631da3d431e495162f5, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:11,817 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1696125671450.6d61171d7943c631da3d431e495162f5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696125671816"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125671816"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125671816"}]},"ts":"1696125671816"} 2023-10-01 02:01:11,822 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 6d61171d7943c631da3d431e495162f5, server=jenkins-hbase17.apache.org,45065,1696125669145}] 2023-10-01 02:01:11,978 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:11,979 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 02:01:11,982 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:55668, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 02:01:11,989 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1696125671450.6d61171d7943c631da3d431e495162f5. 2023-10-01 02:01:11,990 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6d61171d7943c631da3d431e495162f5, NAME => 'hbase:namespace,,1696125671450.6d61171d7943c631da3d431e495162f5.', STARTKEY => '', ENDKEY => ''} 2023-10-01 02:01:11,990 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1696125671450.6d61171d7943c631da3d431e495162f5. service=AccessControlService 2023-10-01 02:01:11,991 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 02:01:11,992 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 6d61171d7943c631da3d431e495162f5 2023-10-01 02:01:11,992 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696125671450.6d61171d7943c631da3d431e495162f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:01:11,992 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 6d61171d7943c631da3d431e495162f5 2023-10-01 02:01:11,992 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 6d61171d7943c631da3d431e495162f5 2023-10-01 02:01:11,999 INFO [StoreOpener-6d61171d7943c631da3d431e495162f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 6d61171d7943c631da3d431e495162f5 2023-10-01 02:01:12,002 DEBUG [StoreOpener-6d61171d7943c631da3d431e495162f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/namespace/6d61171d7943c631da3d431e495162f5/info 2023-10-01 02:01:12,002 DEBUG [StoreOpener-6d61171d7943c631da3d431e495162f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/namespace/6d61171d7943c631da3d431e495162f5/info 2023-10-01 02:01:12,003 INFO [StoreOpener-6d61171d7943c631da3d431e495162f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6d61171d7943c631da3d431e495162f5 columnFamilyName info 2023-10-01 02:01:12,004 INFO [StoreOpener-6d61171d7943c631da3d431e495162f5-1] regionserver.HStore(310): Store=6d61171d7943c631da3d431e495162f5/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 02:01:12,006 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/namespace/6d61171d7943c631da3d431e495162f5 2023-10-01 02:01:12,007 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/namespace/6d61171d7943c631da3d431e495162f5 2023-10-01 02:01:12,013 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 6d61171d7943c631da3d431e495162f5 2023-10-01 02:01:12,020 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/namespace/6d61171d7943c631da3d431e495162f5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 02:01:12,022 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 6d61171d7943c631da3d431e495162f5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70056501, jitterRate=0.043923214077949524}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 02:01:12,022 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 6d61171d7943c631da3d431e495162f5: 2023-10-01 02:01:12,025 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1696125671450.6d61171d7943c631da3d431e495162f5., pid=6, masterSystemTime=1696125671978 2023-10-01 02:01:12,031 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1696125671450.6d61171d7943c631da3d431e495162f5. 2023-10-01 02:01:12,031 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1696125671450.6d61171d7943c631da3d431e495162f5. 2023-10-01 02:01:12,033 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6d61171d7943c631da3d431e495162f5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:12,033 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1696125671450.6d61171d7943c631da3d431e495162f5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696125672032"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696125672032"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696125672032"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696125672032"}]},"ts":"1696125672032"} 2023-10-01 02:01:12,044 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-01 02:01:12,044 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 6d61171d7943c631da3d431e495162f5, server=jenkins-hbase17.apache.org,45065,1696125669145 in 217 msec 2023-10-01 02:01:12,049 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-01 02:01:12,050 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=6d61171d7943c631da3d431e495162f5, ASSIGN in 388 msec 2023-10-01 02:01:12,051 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 02:01:12,052 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125672051"}]},"ts":"1696125672051"} 2023-10-01 02:01:12,055 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-01 02:01:12,058 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 02:01:12,062 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 606 msec 2023-10-01 02:01:12,067 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-01 02:01:12,068 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-01 02:01:12,068 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 02:01:12,093 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:01:12,097 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:55678, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:01:12,110 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-01 02:01:12,131 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-01 02:01:12,138 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 33 msec 2023-10-01 02:01:12,144 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-01 02:01:12,158 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-01 02:01:12,163 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-10-01 02:01:12,170 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-01 02:01:12,172 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-01 02:01:12,172 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.862sec 2023-10-01 02:01:12,175 INFO [master/jenkins-hbase17:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-01 02:01:12,177 INFO [master/jenkins-hbase17:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-01 02:01:12,177 INFO [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-01 02:01:12,178 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,37789,1696125668050-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-01 02:01:12,179 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,37789,1696125668050-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-01 02:01:12,196 DEBUG [Listener at localhost/46623] zookeeper.ReadOnlyZKClient(139): Connect 0x3aa0115b to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:01:12,202 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-01 02:01:12,203 DEBUG [Listener at localhost/46623] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bff348e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:01:12,208 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-10-01 02:01:12,212 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 02:01:12,213 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 02:01:12,217 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-10-01 02:01:12,217 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/hbase/acl/4927cf3d7f9f309e3c0aa87271a3957b 2023-10-01 02:01:12,220 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/hbase/acl/4927cf3d7f9f309e3c0aa87271a3957b empty. 2023-10-01 02:01:12,223 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/hbase/acl/4927cf3d7f9f309e3c0aa87271a3957b 2023-10-01 02:01:12,223 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-10-01 02:01:12,225 DEBUG [hconnection-0x5f6898f7-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:01:12,229 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-01 02:01:12,240 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:41804, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:01:12,243 INFO [Listener at localhost/46623] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase17.apache.org,37789,1696125668050 2023-10-01 02:01:12,243 INFO [Listener at localhost/46623] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-10-01 02:01:12,244 INFO [Listener at localhost/46623] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/test.cache.data in system properties and HBase conf 2023-10-01 02:01:12,244 INFO [Listener at localhost/46623] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/hadoop.tmp.dir in system properties and HBase conf 2023-10-01 02:01:12,244 INFO [Listener at localhost/46623] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/hadoop.log.dir in system properties and HBase conf 2023-10-01 02:01:12,244 INFO [Listener at localhost/46623] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-01 02:01:12,244 INFO [Listener at localhost/46623] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-01 02:01:12,244 INFO [Listener at localhost/46623] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-01 02:01:12,244 INFO [Listener at localhost/46623] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-01 02:01:12,245 INFO [Listener at localhost/46623] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-01 02:01:12,245 INFO [Listener at localhost/46623] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-01 02:01:12,246 INFO [Listener at localhost/46623] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-01 02:01:12,247 INFO [Listener at localhost/46623] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-01 02:01:12,248 INFO [Listener at localhost/46623] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-01 02:01:12,248 INFO [Listener at localhost/46623] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-01 02:01:12,248 INFO [Listener at localhost/46623] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-01 02:01:12,248 INFO [Listener at localhost/46623] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-01 02:01:12,248 INFO [Listener at localhost/46623] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/nfs.dump.dir in system properties and HBase conf 2023-10-01 02:01:12,250 INFO [Listener at localhost/46623] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/java.io.tmpdir in system properties and HBase conf 2023-10-01 02:01:12,250 INFO [Listener at localhost/46623] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-01 02:01:12,250 INFO [Listener at localhost/46623] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-01 02:01:12,250 INFO [Listener at localhost/46623] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-10-01 02:01:12,259 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-10-01 02:01:12,260 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4927cf3d7f9f309e3c0aa87271a3957b, NAME => 'hbase:acl,,1696125672195.4927cf3d7f9f309e3c0aa87271a3957b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp 2023-10-01 02:01:12,305 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696125672195.4927cf3d7f9f309e3c0aa87271a3957b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:01:12,305 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 4927cf3d7f9f309e3c0aa87271a3957b, disabling compactions & flushes 2023-10-01 02:01:12,305 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696125672195.4927cf3d7f9f309e3c0aa87271a3957b. 2023-10-01 02:01:12,305 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696125672195.4927cf3d7f9f309e3c0aa87271a3957b. 2023-10-01 02:01:12,305 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696125672195.4927cf3d7f9f309e3c0aa87271a3957b. after waiting 0 ms 2023-10-01 02:01:12,305 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696125672195.4927cf3d7f9f309e3c0aa87271a3957b. 2023-10-01 02:01:12,305 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1696125672195.4927cf3d7f9f309e3c0aa87271a3957b. 2023-10-01 02:01:12,306 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 4927cf3d7f9f309e3c0aa87271a3957b: 2023-10-01 02:01:12,314 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 02:01:12,317 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1696125672195.4927cf3d7f9f309e3c0aa87271a3957b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696125672316"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125672316"}]},"ts":"1696125672316"} 2023-10-01 02:01:12,328 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-01 02:01:12,335 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-01 02:01:12,337 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 02:01:12,338 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125672337"}]},"ts":"1696125672337"} 2023-10-01 02:01:12,342 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-10-01 02:01:12,347 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-10-01 02:01:12,348 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 02:01:12,348 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 02:01:12,348 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 02:01:12,348 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 02:01:12,348 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=4927cf3d7f9f309e3c0aa87271a3957b, ASSIGN}] 2023-10-01 02:01:12,352 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=4927cf3d7f9f309e3c0aa87271a3957b, ASSIGN 2023-10-01 02:01:12,354 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=4927cf3d7f9f309e3c0aa87271a3957b, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,45065,1696125669145; forceNewPlan=false, retain=false 2023-10-01 02:01:12,504 INFO [jenkins-hbase17:37789] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-01 02:01:12,505 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=4927cf3d7f9f309e3c0aa87271a3957b, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:12,506 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1696125672195.4927cf3d7f9f309e3c0aa87271a3957b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696125672505"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125672505"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125672505"}]},"ts":"1696125672505"} 2023-10-01 02:01:12,509 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 4927cf3d7f9f309e3c0aa87271a3957b, server=jenkins-hbase17.apache.org,45065,1696125669145}] 2023-10-01 02:01:12,537 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-01 02:01:12,670 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1696125672195.4927cf3d7f9f309e3c0aa87271a3957b. 2023-10-01 02:01:12,670 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4927cf3d7f9f309e3c0aa87271a3957b, NAME => 'hbase:acl,,1696125672195.4927cf3d7f9f309e3c0aa87271a3957b.', STARTKEY => '', ENDKEY => ''} 2023-10-01 02:01:12,670 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1696125672195.4927cf3d7f9f309e3c0aa87271a3957b. service=AccessControlService 2023-10-01 02:01:12,671 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 02:01:12,671 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 4927cf3d7f9f309e3c0aa87271a3957b 2023-10-01 02:01:12,671 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696125672195.4927cf3d7f9f309e3c0aa87271a3957b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:01:12,671 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 4927cf3d7f9f309e3c0aa87271a3957b 2023-10-01 02:01:12,671 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 4927cf3d7f9f309e3c0aa87271a3957b 2023-10-01 02:01:12,674 INFO [StoreOpener-4927cf3d7f9f309e3c0aa87271a3957b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 4927cf3d7f9f309e3c0aa87271a3957b 2023-10-01 02:01:12,676 DEBUG [StoreOpener-4927cf3d7f9f309e3c0aa87271a3957b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/acl/4927cf3d7f9f309e3c0aa87271a3957b/l 2023-10-01 02:01:12,677 DEBUG [StoreOpener-4927cf3d7f9f309e3c0aa87271a3957b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/acl/4927cf3d7f9f309e3c0aa87271a3957b/l 2023-10-01 02:01:12,677 INFO [StoreOpener-4927cf3d7f9f309e3c0aa87271a3957b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4927cf3d7f9f309e3c0aa87271a3957b columnFamilyName l 2023-10-01 02:01:12,678 INFO [StoreOpener-4927cf3d7f9f309e3c0aa87271a3957b-1] regionserver.HStore(310): Store=4927cf3d7f9f309e3c0aa87271a3957b/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 02:01:12,681 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/acl/4927cf3d7f9f309e3c0aa87271a3957b 2023-10-01 02:01:12,683 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/acl/4927cf3d7f9f309e3c0aa87271a3957b 2023-10-01 02:01:12,689 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 4927cf3d7f9f309e3c0aa87271a3957b 2023-10-01 02:01:12,694 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/acl/4927cf3d7f9f309e3c0aa87271a3957b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 02:01:12,695 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 4927cf3d7f9f309e3c0aa87271a3957b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64855143, jitterRate=-0.033583059906959534}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 02:01:12,695 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 4927cf3d7f9f309e3c0aa87271a3957b: 2023-10-01 02:01:12,697 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1696125672195.4927cf3d7f9f309e3c0aa87271a3957b., pid=11, masterSystemTime=1696125672663 2023-10-01 02:01:12,703 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1696125672195.4927cf3d7f9f309e3c0aa87271a3957b. 2023-10-01 02:01:12,703 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1696125672195.4927cf3d7f9f309e3c0aa87271a3957b. 2023-10-01 02:01:12,704 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=4927cf3d7f9f309e3c0aa87271a3957b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:12,705 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1696125672195.4927cf3d7f9f309e3c0aa87271a3957b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696125672704"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696125672704"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696125672704"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696125672704"}]},"ts":"1696125672704"} 2023-10-01 02:01:12,713 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-01 02:01:12,713 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 4927cf3d7f9f309e3c0aa87271a3957b, server=jenkins-hbase17.apache.org,45065,1696125669145 in 200 msec 2023-10-01 02:01:12,719 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-01 02:01:12,719 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=4927cf3d7f9f309e3c0aa87271a3957b, ASSIGN in 365 msec 2023-10-01 02:01:12,721 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 02:01:12,722 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125672721"}]},"ts":"1696125672721"} 2023-10-01 02:01:12,725 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-10-01 02:01:12,728 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 02:01:12,734 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 526 msec 2023-10-01 02:01:12,837 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-01 02:01:12,837 INFO [master/jenkins-hbase17:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-10-01 02:01:12,865 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-01 02:01:13,608 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 02:01:13,902 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 02:01:13,908 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_38783_jobhistory____843hfm/webapp 2023-10-01 02:01:14,062 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-10-01 02:01:14,062 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-10-01 02:01:14,062 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-01 02:01:14,066 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-01 02:01:14,146 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 02:01:14,453 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 02:01:14,837 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-10-01 02:01:14,878 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:38783 2023-10-01 02:01:15,105 WARN [Listener at jenkins-hbase17.apache.org/34111] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 02:01:15,350 WARN [Listener at jenkins-hbase17.apache.org/34111] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-01 02:01:15,350 INFO [Listener at jenkins-hbase17.apache.org/34111] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 02:01:15,358 INFO [Listener at jenkins-hbase17.apache.org/34111] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_41053_cluster____.d13tqx/webapp 2023-10-01 02:01:15,421 INFO [Listener at jenkins-hbase17.apache.org/34111] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-10-01 02:01:15,421 INFO [Listener at jenkins-hbase17.apache.org/34111] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-10-01 02:01:15,421 INFO [Listener at jenkins-hbase17.apache.org/34111] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-01 02:01:15,422 INFO [Listener at jenkins-hbase17.apache.org/34111] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-01 02:01:15,431 INFO [Listener at jenkins-hbase17.apache.org/34111] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 02:01:15,647 INFO [Listener at jenkins-hbase17.apache.org/34111] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 02:01:15,773 INFO [Listener at jenkins-hbase17.apache.org/34111] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 02:01:15,786 INFO [Listener at jenkins-hbase17.apache.org/34111] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:41053 2023-10-01 02:01:16,370 WARN [Listener at jenkins-hbase17.apache.org/46087] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 02:01:16,405 WARN [Listener at jenkins-hbase17.apache.org/46087] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-01 02:01:16,406 INFO [Listener at jenkins-hbase17.apache.org/46087] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 02:01:16,416 INFO [Listener at jenkins-hbase17.apache.org/46087] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_40791_node____8gpkt/webapp 2023-10-01 02:01:16,469 INFO [Listener at jenkins-hbase17.apache.org/46087] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-01 02:01:16,470 INFO [Listener at jenkins-hbase17.apache.org/46087] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-01 02:01:16,470 INFO [Listener at jenkins-hbase17.apache.org/46087] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-01 02:01:16,470 INFO [Listener at jenkins-hbase17.apache.org/46087] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-01 02:01:16,481 INFO [Listener at jenkins-hbase17.apache.org/46087] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 02:01:16,500 INFO [Listener at jenkins-hbase17.apache.org/46087] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 02:01:16,598 INFO [Listener at jenkins-hbase17.apache.org/46087] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 02:01:16,614 INFO [Listener at jenkins-hbase17.apache.org/46087] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:40791 2023-10-01 02:01:16,733 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 02:01:16,804 WARN [Listener at jenkins-hbase17.apache.org/41447] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 02:01:16,817 WARN [Listener at jenkins-hbase17.apache.org/41447] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-01 02:01:16,818 INFO [Listener at jenkins-hbase17.apache.org/41447] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 02:01:16,832 INFO [Listener at jenkins-hbase17.apache.org/41447] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_40517_node____.mndtrr/webapp 2023-10-01 02:01:16,915 INFO [Listener at jenkins-hbase17.apache.org/41447] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-01 02:01:16,915 INFO [Listener at jenkins-hbase17.apache.org/41447] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-01 02:01:16,916 INFO [Listener at jenkins-hbase17.apache.org/41447] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-01 02:01:16,916 INFO [Listener at jenkins-hbase17.apache.org/41447] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-01 02:01:16,930 INFO [Listener at jenkins-hbase17.apache.org/41447] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 02:01:16,934 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-01 02:01:16,935 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-10-01 02:01:16,936 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-01 02:01:16,952 INFO [Listener at jenkins-hbase17.apache.org/41447] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 02:01:17,024 INFO [Listener at jenkins-hbase17.apache.org/41447] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 02:01:17,030 INFO [Listener at jenkins-hbase17.apache.org/41447] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:40517 2023-10-01 02:01:17,064 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-10-01 02:01:17,065 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 02:01:17,129 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=709, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=376, ProcessCount=178, AvailableMemoryMB=9617 2023-10-01 02:01:17,129 WARN [Listener at jenkins-hbase17.apache.org/41447] hbase.ResourceChecker(130): Thread=709 is superior to 500 2023-10-01 02:01:17,142 DEBUG [Listener at jenkins-hbase17.apache.org/41447] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-01 02:01:17,148 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:60294, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-01 02:01:17,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 02:01:17,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-10-01 02:01:17,162 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 02:01:17,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-10-01 02:01:17,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-01 02:01:17,166 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 02:01:17,171 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportWithTargetName/4a722c90a030a191abf822734e92a802 2023-10-01 02:01:17,171 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportWithTargetName/a3acf78910c0156ef618e27a13065ef7 2023-10-01 02:01:17,173 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportWithTargetName/4a722c90a030a191abf822734e92a802 empty. 2023-10-01 02:01:17,173 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportWithTargetName/a3acf78910c0156ef618e27a13065ef7 empty. 2023-10-01 02:01:17,175 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportWithTargetName/4a722c90a030a191abf822734e92a802 2023-10-01 02:01:17,177 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportWithTargetName/a3acf78910c0156ef618e27a13065ef7 2023-10-01 02:01:17,177 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-01 02:01:17,215 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-10-01 02:01:17,217 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4a722c90a030a191abf822734e92a802, NAME => 'testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp 2023-10-01 02:01:17,217 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => a3acf78910c0156ef618e27a13065ef7, NAME => 'testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp 2023-10-01 02:01:17,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-01 02:01:17,271 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:01:17,271 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:01:17,271 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing a3acf78910c0156ef618e27a13065ef7, disabling compactions & flushes 2023-10-01 02:01:17,271 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 4a722c90a030a191abf822734e92a802, disabling compactions & flushes 2023-10-01 02:01:17,271 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7. 2023-10-01 02:01:17,271 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802. 2023-10-01 02:01:17,272 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7. 2023-10-01 02:01:17,272 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802. 2023-10-01 02:01:17,272 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802. after waiting 0 ms 2023-10-01 02:01:17,272 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802. 2023-10-01 02:01:17,272 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7. after waiting 0 ms 2023-10-01 02:01:17,272 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802. 2023-10-01 02:01:17,272 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7. 2023-10-01 02:01:17,272 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 4a722c90a030a191abf822734e92a802: 2023-10-01 02:01:17,272 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7. 2023-10-01 02:01:17,272 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for a3acf78910c0156ef618e27a13065ef7: 2023-10-01 02:01:17,276 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 02:01:17,278 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696125677277"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125677277"}]},"ts":"1696125677277"} 2023-10-01 02:01:17,278 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696125677277"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125677277"}]},"ts":"1696125677277"} 2023-10-01 02:01:17,323 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 02:01:17,325 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 02:01:17,325 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125677325"}]},"ts":"1696125677325"} 2023-10-01 02:01:17,328 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-10-01 02:01:17,331 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-10-01 02:01:17,335 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 02:01:17,335 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 02:01:17,335 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 02:01:17,335 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 02:01:17,336 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4a722c90a030a191abf822734e92a802, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a3acf78910c0156ef618e27a13065ef7, ASSIGN}] 2023-10-01 02:01:17,339 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a3acf78910c0156ef618e27a13065ef7, ASSIGN 2023-10-01 02:01:17,339 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4a722c90a030a191abf822734e92a802, ASSIGN 2023-10-01 02:01:17,341 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a3acf78910c0156ef618e27a13065ef7, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,44975,1696125669240; forceNewPlan=false, retain=false 2023-10-01 02:01:17,341 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4a722c90a030a191abf822734e92a802, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,43503,1696125669195; forceNewPlan=false, retain=false 2023-10-01 02:01:17,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-01 02:01:17,491 INFO [jenkins-hbase17:37789] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 02:01:17,494 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4a722c90a030a191abf822734e92a802, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:17,494 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a3acf78910c0156ef618e27a13065ef7, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:17,494 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696125677493"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125677493"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125677493"}]},"ts":"1696125677493"} 2023-10-01 02:01:17,494 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696125677493"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125677493"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125677493"}]},"ts":"1696125677493"} 2023-10-01 02:01:17,497 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 4a722c90a030a191abf822734e92a802, server=jenkins-hbase17.apache.org,43503,1696125669195}] 2023-10-01 02:01:17,498 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure a3acf78910c0156ef618e27a13065ef7, server=jenkins-hbase17.apache.org,44975,1696125669240}] 2023-10-01 02:01:17,652 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:17,652 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 02:01:17,659 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:44496, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 02:01:17,664 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802. 2023-10-01 02:01:17,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4a722c90a030a191abf822734e92a802, NAME => 'testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 02:01:17,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802. service=AccessControlService 2023-10-01 02:01:17,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 02:01:17,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 4a722c90a030a191abf822734e92a802 2023-10-01 02:01:17,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:01:17,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 4a722c90a030a191abf822734e92a802 2023-10-01 02:01:17,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 4a722c90a030a191abf822734e92a802 2023-10-01 02:01:17,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7. 2023-10-01 02:01:17,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a3acf78910c0156ef618e27a13065ef7, NAME => 'testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 02:01:17,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7. service=AccessControlService 2023-10-01 02:01:17,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 02:01:17,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName a3acf78910c0156ef618e27a13065ef7 2023-10-01 02:01:17,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:01:17,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for a3acf78910c0156ef618e27a13065ef7 2023-10-01 02:01:17,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for a3acf78910c0156ef618e27a13065ef7 2023-10-01 02:01:17,669 INFO [StoreOpener-4a722c90a030a191abf822734e92a802-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4a722c90a030a191abf822734e92a802 2023-10-01 02:01:17,669 INFO [StoreOpener-a3acf78910c0156ef618e27a13065ef7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a3acf78910c0156ef618e27a13065ef7 2023-10-01 02:01:17,671 DEBUG [StoreOpener-4a722c90a030a191abf822734e92a802-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportWithTargetName/4a722c90a030a191abf822734e92a802/cf 2023-10-01 02:01:17,671 DEBUG [StoreOpener-4a722c90a030a191abf822734e92a802-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportWithTargetName/4a722c90a030a191abf822734e92a802/cf 2023-10-01 02:01:17,672 DEBUG [StoreOpener-a3acf78910c0156ef618e27a13065ef7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportWithTargetName/a3acf78910c0156ef618e27a13065ef7/cf 2023-10-01 02:01:17,672 DEBUG [StoreOpener-a3acf78910c0156ef618e27a13065ef7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportWithTargetName/a3acf78910c0156ef618e27a13065ef7/cf 2023-10-01 02:01:17,675 INFO [StoreOpener-a3acf78910c0156ef618e27a13065ef7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3acf78910c0156ef618e27a13065ef7 columnFamilyName cf 2023-10-01 02:01:17,675 INFO [StoreOpener-4a722c90a030a191abf822734e92a802-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a722c90a030a191abf822734e92a802 columnFamilyName cf 2023-10-01 02:01:17,679 INFO [StoreOpener-a3acf78910c0156ef618e27a13065ef7-1] regionserver.HStore(310): Store=a3acf78910c0156ef618e27a13065ef7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 02:01:17,679 INFO [StoreOpener-4a722c90a030a191abf822734e92a802-1] regionserver.HStore(310): Store=4a722c90a030a191abf822734e92a802/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 02:01:17,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportWithTargetName/a3acf78910c0156ef618e27a13065ef7 2023-10-01 02:01:17,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportWithTargetName/4a722c90a030a191abf822734e92a802 2023-10-01 02:01:17,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportWithTargetName/4a722c90a030a191abf822734e92a802 2023-10-01 02:01:17,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportWithTargetName/a3acf78910c0156ef618e27a13065ef7 2023-10-01 02:01:17,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for a3acf78910c0156ef618e27a13065ef7 2023-10-01 02:01:17,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 4a722c90a030a191abf822734e92a802 2023-10-01 02:01:17,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportWithTargetName/a3acf78910c0156ef618e27a13065ef7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 02:01:17,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened a3acf78910c0156ef618e27a13065ef7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72852147, jitterRate=0.08558158576488495}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 02:01:17,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for a3acf78910c0156ef618e27a13065ef7: 2023-10-01 02:01:17,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7., pid=16, masterSystemTime=1696125677652 2023-10-01 02:01:17,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportWithTargetName/4a722c90a030a191abf822734e92a802/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 02:01:17,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 4a722c90a030a191abf822734e92a802; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61203326, jitterRate=-0.0879993736743927}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 02:01:17,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7. 2023-10-01 02:01:17,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 4a722c90a030a191abf822734e92a802: 2023-10-01 02:01:17,714 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7. 2023-10-01 02:01:17,715 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802., pid=15, masterSystemTime=1696125677650 2023-10-01 02:01:17,715 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a3acf78910c0156ef618e27a13065ef7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:17,716 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696125677715"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696125677715"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696125677715"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696125677715"}]},"ts":"1696125677715"} 2023-10-01 02:01:17,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802. 2023-10-01 02:01:17,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802. 2023-10-01 02:01:17,720 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4a722c90a030a191abf822734e92a802, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:17,725 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696125677720"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696125677720"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696125677720"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696125677720"}]},"ts":"1696125677720"} 2023-10-01 02:01:17,730 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-10-01 02:01:17,731 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure a3acf78910c0156ef618e27a13065ef7, server=jenkins-hbase17.apache.org,44975,1696125669240 in 221 msec 2023-10-01 02:01:17,734 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a3acf78910c0156ef618e27a13065ef7, ASSIGN in 395 msec 2023-10-01 02:01:17,737 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-10-01 02:01:17,737 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 4a722c90a030a191abf822734e92a802, server=jenkins-hbase17.apache.org,43503,1696125669195 in 232 msec 2023-10-01 02:01:17,740 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-10-01 02:01:17,740 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4a722c90a030a191abf822734e92a802, ASSIGN in 401 msec 2023-10-01 02:01:17,741 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 02:01:17,741 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125677741"}]},"ts":"1696125677741"} 2023-10-01 02:01:17,743 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-10-01 02:01:17,746 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 02:01:17,751 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-10-01 02:01:17,765 DEBUG [hconnection-0x75c4592-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:01:17,768 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:41812, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-10-01 02:01:17,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-01 02:01:17,777 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45065] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-01 02:01:17,803 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-01 02:01:17,803 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-01 02:01:17,803 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-01 02:01:17,803 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-01 02:01:17,804 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 02:01:17,811 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-01 02:01:17,811 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-01 02:01:17,811 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-01 02:01:17,811 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-01 02:01:17,814 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 655 msec 2023-10-01 02:01:18,201 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 02:01:18,202 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-10-01 02:01:18,202 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 02:01:18,202 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-10-01 02:01:18,203 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-01 02:01:18,203 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-10-01 02:01:18,203 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 02:01:18,203 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-10-01 02:01:18,203 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-01 02:01:18,203 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-01 02:01:18,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-01 02:01:18,277 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-10-01 02:01:18,281 DEBUG [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-01 02:01:18,282 DEBUG [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802. 2023-10-01 02:01:18,285 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 02:01:18,313 DEBUG [hconnection-0x5f6898f7-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:01:18,319 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:44498, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:01:18,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 02:01:18,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696125678334 (current time:1696125678334). 2023-10-01 02:01:18,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 02:01:18,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(139): Connect 0x3fe43a4f to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:01:18,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55585673, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:01:18,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:01:18,349 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:41824, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:01:18,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3fe43a4f to 127.0.0.1:51733 2023-10-01 02:01:18,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:01:18,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(139): Connect 0x75c51594 to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:01:18,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d77392, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:01:18,364 DEBUG [hconnection-0x700f8266-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:01:18,366 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:41836, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:01:18,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:01:18,373 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:55692, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:01:18,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75c51594 to 127.0.0.1:51733 2023-10-01 02:01:18,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:01:18,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-01 02:01:18,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 02:01:18,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 02:01:18,421 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot, current working dir path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 02:01:18,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 02:01:18,442 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 02:01:18,443 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696126278443 2023-10-01 02:01:18,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 02:01:18,444 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-01 02:01:18,447 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 02:01:18,449 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 02:01:18,450 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-10-01 02:01:18,451 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 02:01:18,452 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696126278452 2023-10-01 02:01:18,453 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 02:01:18,453 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 02:01:18,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,487 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-10-01 02:01:18,487 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:01:18,488 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-10-01 02:01:18,488 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-01 02:01:18,488 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,488 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,491 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:18,491 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:18,491 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:18,491 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:18,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:18,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:18,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:18,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:18,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:18,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:18,491 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:18,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,492 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:18,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,492 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:18,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,492 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 02:01:18,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-01 02:01:18,493 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-01 02:01:18,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-01 02:01:18,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,494 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 02:01:18,494 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 02:01:18,494 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 02:01:18,500 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,500 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,500 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,500 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 02:01:18,501 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 02:01:18,501 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 02:01:18,501 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:01:18,501 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:01:18,502 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 02:01:18,501 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:01:18,503 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-01 02:01:18,503 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 02:01:18,505 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44975,1696125669240' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-01 02:01:18,504 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 02:01:18,505 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-01 02:01:18,505 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-01 02:01:18,505 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,45065,1696125669145' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-01 02:01:18,505 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,43503,1696125669195' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-01 02:01:18,507 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,507 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:18,508 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:18,508 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:18,508 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:01:18,508 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,508 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:18,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:18,508 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,508 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:01:18,508 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,508 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:01:18,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:18,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:18,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:18,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:18,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:18,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:18,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44975,1696125669240' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-01 02:01:18,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@502285a[Count = 1] remaining members to acquire global barrier 2023-10-01 02:01:18,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:18,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:18,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:18,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:18,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:18,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:18,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:18,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:18,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:18,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,43503,1696125669195' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-01 02:01:18,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@502285a[Count = 0] remaining members to acquire global barrier 2023-10-01 02:01:18,514 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-01 02:01:18,514 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,517 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,517 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,517 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,517 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 02:01:18,518 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 02:01:18,517 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:18,518 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-01 02:01:18,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,518 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,45065,1696125669145' in zk 2023-10-01 02:01:18,518 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 02:01:18,518 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:18,518 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 02:01:18,520 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 02:01:18,521 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802. 2023-10-01 02:01:18,521 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7. 2023-10-01 02:01:18,521 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 02:01:18,521 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 02:01:18,521 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 02:01:18,521 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 02:01:18,521 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:01:18,521 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-01 02:01:18,521 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802. started... 2023-10-01 02:01:18,521 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7. started... 2023-10-01 02:01:18,526 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4a722c90a030a191abf822734e92a802: 2023-10-01 02:01:18,526 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a3acf78910c0156ef618e27a13065ef7: 2023-10-01 02:01:18,527 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,527 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,532 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 02:01:18,532 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 02:01:18,536 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 02:01:18,536 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 02:01:18,553 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 02:01:18,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-01 02:01:18,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-01 02:01:18,577 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 02:01:18,582 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802. completed. 2023-10-01 02:01:18,582 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802. 2023-10-01 02:01:18,583 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 02:01:18,583 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 02:01:18,583 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:18,583 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-01 02:01:18,583 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,43503,1696125669195' in zk 2023-10-01 02:01:18,584 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7. completed. 2023-10-01 02:01:18,584 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7. 2023-10-01 02:01:18,584 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 02:01:18,584 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 02:01:18,584 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:18,584 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-01 02:01:18,584 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,44975,1696125669240' in zk 2023-10-01 02:01:18,584 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 02:01:18,584 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:18,584 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:01:18,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:18,584 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-01 02:01:18,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:18,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:18,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:18,586 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:18,586 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 02:01:18,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:18,586 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:01:18,587 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-01 02:01:18,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:18,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:18,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:18,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:18,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:18,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:18,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:18,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,43503,1696125669195': 2023-10-01 02:01:18,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,43503,1696125669195' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-01 02:01:18,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:18,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:18,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:18,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:18,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:18,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:18,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:18,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:18,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:18,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:18,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:18,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:18,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,44975,1696125669240': 2023-10-01 02:01:18,595 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44975,1696125669240' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-01 02:01:18,595 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-10-01 02:01:18,595 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 02:01:18,595 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 02:01:18,595 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,595 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 02:01:18,598 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,598 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,598 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,598 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:18,598 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,598 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:18,598 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:18,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:18,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:18,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:18,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:18,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:18,599 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:18,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:18,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:18,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:18,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:18,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,600 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:18,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,600 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:18,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:18,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:18,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:18,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:18,602 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:18,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:18,602 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:18,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,602 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:18,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:18,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:18,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:18,616 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:18,617 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:18,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:18,617 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:18,617 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:18,617 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,617 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:18,617 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:18,617 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,616 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:18,617 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:18,617 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:01:18,617 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:18,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:18,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:18,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:18,617 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:18,617 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-01 02:01:18,617 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:18,617 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:18,618 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,618 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:18,618 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 02:01:18,618 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:18,618 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,618 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:18,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:18,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:18,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:18,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:18,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 02:01:18,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:18,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,702 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-01 02:01:18,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,703 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:18,703 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696125678444Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696125678640 (+196 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1696125678640Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1696125678640Writing data manifest for emptySnaptb0-testExportWithTargetName at 1696125678657 (+17 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1696125678689 (+32 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696125678702 (+13 ms) 2023-10-01 02:01:18,705 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 02:01:18,707 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 257 msec 2023-10-01 02:01:18,779 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 02:01:18,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-01 02:01:18,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 02:01:18,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43503] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 02:01:18,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44975] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 02:01:18,803 DEBUG [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-01 02:01:18,803 DEBUG [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802. 2023-10-01 02:01:18,803 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 02:01:18,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 02:01:18,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696125678823 (current time:1696125678823). 2023-10-01 02:01:18,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 02:01:18,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(139): Connect 0x77800df8 to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:01:18,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ce056cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:01:18,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:01:18,836 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:41850, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:01:18,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77800df8 to 127.0.0.1:51733 2023-10-01 02:01:18,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:01:18,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(139): Connect 0x22e89c39 to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:01:18,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5570aa51, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:01:18,847 DEBUG [hconnection-0x2bd8d005-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:01:18,850 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:41852, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:01:18,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:01:18,859 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:55694, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:01:18,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x22e89c39 to 127.0.0.1:51733 2023-10-01 02:01:18,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:01:18,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-01 02:01:18,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 02:01:18,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 02:01:18,866 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot, current working dir path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 02:01:18,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 02:01:18,870 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 02:01:18,872 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696126278872 2023-10-01 02:01:18,872 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-01 02:01:18,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 02:01:18,873 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 02:01:18,873 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 02:01:18,879 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 02:01:18,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 02:01:18,882 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 12 msec 2023-10-01 02:01:18,884 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 02:01:18,885 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696126278885 2023-10-01 02:01:18,906 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-10-01 02:01:18,909 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-10-01 02:01:18,909 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:01:18,910 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-10-01 02:01:18,910 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-01 02:01:18,911 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 02:01:18,911 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 02:01:18,912 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:18,912 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:18,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:18,912 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:18,912 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:18,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:18,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:18,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:18,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:18,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:18,913 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:18,913 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:18,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 02:01:18,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 02:01:18,913 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:18,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 02:01:18,913 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 02:01:18,913 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 02:01:18,913 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 02:01:18,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 02:01:18,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-01 02:01:18,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-01 02:01:18,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 02:01:18,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 02:01:18,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-01 02:01:18,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 02:01:18,914 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 02:01:18,914 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 02:01:18,914 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 02:01:18,914 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-01 02:01:18,914 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-01 02:01:18,914 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-01 02:01:18,915 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 02:01:18,915 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 02:01:18,914 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 02:01:18,915 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:01:18,915 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:01:18,916 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 02:01:18,915 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:01:18,918 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-01 02:01:18,919 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44975,1696125669240' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-01 02:01:18,918 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 02:01:18,919 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-01 02:01:18,919 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 02:01:18,919 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,43503,1696125669195' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-01 02:01:18,919 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-01 02:01:18,919 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,45065,1696125669145' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-01 02:01:18,921 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:18,921 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 02:01:18,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:18,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:18,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:18,922 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 02:01:18,922 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 02:01:18,922 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:18,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:18,922 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 02:01:18,922 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:01:18,922 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 02:01:18,922 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:01:18,922 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 02:01:18,922 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:01:18,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:18,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 02:01:18,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:18,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:18,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:18,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:18,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44975,1696125669240' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-01 02:01:18,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@175a7565[Count = 1] remaining members to acquire global barrier 2023-10-01 02:01:18,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:18,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:18,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:18,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:18,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:18,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 02:01:18,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:18,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:18,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:18,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:18,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,43503,1696125669195' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-01 02:01:18,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@175a7565[Count = 0] remaining members to acquire global barrier 2023-10-01 02:01:18,927 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-01 02:01:18,927 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 02:01:18,929 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 02:01:18,929 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 02:01:18,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 02:01:18,929 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 02:01:18,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 02:01:18,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 02:01:18,929 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 02:01:18,929 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:18,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 02:01:18,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 02:01:18,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 02:01:18,930 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 02:01:18,930 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7. 2023-10-01 02:01:18,930 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 02:01:18,930 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 02:01:18,930 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 02:01:18,930 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 02:01:18,930 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7. started... 2023-10-01 02:01:18,930 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:18,930 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 02:01:18,930 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 02:01:18,930 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802. 2023-10-01 02:01:18,930 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-01 02:01:18,930 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802. started... 2023-10-01 02:01:18,930 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,45065,1696125669145' in zk 2023-10-01 02:01:18,930 INFO [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4a722c90a030a191abf822734e92a802 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-01 02:01:18,930 INFO [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a3acf78910c0156ef618e27a13065ef7 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-01 02:01:18,933 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 02:01:18,933 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:01:18,933 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-01 02:01:18,974 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 02:01:18,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-01 02:01:18,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-01 02:01:18,976 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 02:01:19,074 INFO [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231001a15cca2b655b456681f4d42fa6a708e6 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231001a15cca2b655b456681f4d42fa6a708e6 2023-10-01 02:01:19,102 INFO [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportWithTargetName/4a722c90a030a191abf822734e92a802/.tmp/cf/e96eaa1372884b57b48b622fb80a8b69 2023-10-01 02:01:19,113 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportWithTargetName/4a722c90a030a191abf822734e92a802/.tmp/cf/e96eaa1372884b57b48b622fb80a8b69 as hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportWithTargetName/4a722c90a030a191abf822734e92a802/cf/e96eaa1372884b57b48b622fb80a8b69 2023-10-01 02:01:19,123 INFO [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportWithTargetName/4a722c90a030a191abf822734e92a802/cf/e96eaa1372884b57b48b622fb80a8b69, entries=3, sequenceid=6, filesize=5.4 K 2023-10-01 02:01:19,125 INFO [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 4a722c90a030a191abf822734e92a802 in 195ms, sequenceid=6, compaction requested=false 2023-10-01 02:01:19,125 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-01 02:01:19,126 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4a722c90a030a191abf822734e92a802: 2023-10-01 02:01:19,126 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-01 02:01:19,126 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 02:01:19,126 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportWithTargetName/4a722c90a030a191abf822734e92a802/cf/e96eaa1372884b57b48b622fb80a8b69] hfiles 2023-10-01 02:01:19,126 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportWithTargetName/4a722c90a030a191abf822734e92a802/cf/e96eaa1372884b57b48b622fb80a8b69 for snapshot=snaptb0-testExportWithTargetName 2023-10-01 02:01:19,145 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802. completed. 2023-10-01 02:01:19,145 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802. 2023-10-01 02:01:19,145 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 02:01:19,147 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 02:01:19,147 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:19,147 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-01 02:01:19,147 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,43503,1696125669195' in zk 2023-10-01 02:01:19,148 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:19,148 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 02:01:19,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:19,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:19,148 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:01:19,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:19,149 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-01 02:01:19,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:19,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:19,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 02:01:19,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:19,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:19,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:19,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:19,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 02:01:19,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:19,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:19,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,43503,1696125669195': 2023-10-01 02:01:19,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,43503,1696125669195' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-01 02:01:19,176 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 02:01:19,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-01 02:01:19,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-01 02:01:19,178 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-01 02:01:19,438 INFO [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231001b955aeffea3246f89caead365c651c55 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231001b955aeffea3246f89caead365c651c55 2023-10-01 02:01:19,453 INFO [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportWithTargetName/a3acf78910c0156ef618e27a13065ef7/.tmp/cf/f1c7ffff84514db5b652ba4f610cb990 2023-10-01 02:01:19,461 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportWithTargetName/a3acf78910c0156ef618e27a13065ef7/.tmp/cf/f1c7ffff84514db5b652ba4f610cb990 as hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportWithTargetName/a3acf78910c0156ef618e27a13065ef7/cf/f1c7ffff84514db5b652ba4f610cb990 2023-10-01 02:01:19,473 INFO [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportWithTargetName/a3acf78910c0156ef618e27a13065ef7/cf/f1c7ffff84514db5b652ba4f610cb990, entries=47, sequenceid=6, filesize=12.8 K 2023-10-01 02:01:19,475 INFO [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for a3acf78910c0156ef618e27a13065ef7 in 545ms, sequenceid=6, compaction requested=false 2023-10-01 02:01:19,476 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a3acf78910c0156ef618e27a13065ef7: 2023-10-01 02:01:19,477 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-01 02:01:19,477 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 02:01:19,477 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportWithTargetName/a3acf78910c0156ef618e27a13065ef7/cf/f1c7ffff84514db5b652ba4f610cb990] hfiles 2023-10-01 02:01:19,477 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportWithTargetName/a3acf78910c0156ef618e27a13065ef7/cf/f1c7ffff84514db5b652ba4f610cb990 for snapshot=snaptb0-testExportWithTargetName 2023-10-01 02:01:19,478 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 02:01:19,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-01 02:01:19,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-01 02:01:19,482 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-01 02:01:19,501 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7. completed. 2023-10-01 02:01:19,502 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7. 2023-10-01 02:01:19,502 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 02:01:19,502 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 02:01:19,502 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:19,502 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-01 02:01:19,502 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,44975,1696125669240' in zk 2023-10-01 02:01:19,503 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:19,503 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 02:01:19,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:19,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:19,503 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:01:19,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:19,504 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-01 02:01:19,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:19,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:19,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 02:01:19,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:19,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:19,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:19,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:19,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 02:01:19,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:19,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:19,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:19,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,44975,1696125669240': 2023-10-01 02:01:19,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44975,1696125669240' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-01 02:01:19,510 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-10-01 02:01:19,510 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 02:01:19,510 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 02:01:19,510 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-10-01 02:01:19,510 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 02:01:19,511 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 02:01:19,511 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 02:01:19,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 02:01:19,511 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 02:01:19,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 02:01:19,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 02:01:19,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 02:01:19,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 02:01:19,511 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 02:01:19,511 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:19,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 02:01:19,512 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:19,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:19,511 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:19,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:19,512 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:19,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:19,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:19,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 02:01:19,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:19,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:19,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:19,513 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:19,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 02:01:19,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 02:01:19,513 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:19,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:19,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 02:01:19,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:19,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 02:01:19,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:19,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 02:01:19,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:19,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:19,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:19,515 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:19,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:19,516 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:19,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 02:01:19,516 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:19,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:19,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:19,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:19,529 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:19,529 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:19,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:19,530 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:19,530 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:19,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:19,530 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-10-01 02:01:19,529 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:19,530 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-01 02:01:19,529 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:19,530 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 02:01:19,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:19,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:19,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:19,530 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:01:19,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:19,530 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:19,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-01 02:01:19,530 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:19,531 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 02:01:19,531 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:19,532 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 02:01:19,532 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:19,532 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 02:01:19,532 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:19,532 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:19,532 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 02:01:19,532 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 02:01:19,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:19,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:19,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:19,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:19,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:19,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:19,533 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231001b955aeffea3246f89caead365c651c55, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231001a15cca2b655b456681f4d42fa6a708e6] mob files 2023-10-01 02:01:19,533 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231001b955aeffea3246f89caead365c651c55 2023-10-01 02:01:19,533 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231001a15cca2b655b456681f4d42fa6a708e6 2023-10-01 02:01:19,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-10-01 02:01:19,554 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-01 02:01:19,597 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-01 02:01:19,599 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-01 02:01:19,599 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-01 02:01:19,599 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-01 02:01:19,599 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696125678872Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696125679553 (+681 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1696125679553Loading Region manifests for snaptb0-testExportWithTargetName at 1696125679553Writing data manifest for snaptb0-testExportWithTargetName at 1696125679558 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1696125679584 (+26 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696125679599 (+15 ms) 2023-10-01 02:01:19,602 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 02:01:19,606 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 726 msec 2023-10-01 02:01:19,982 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 02:01:19,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-01 02:01:19,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 02:01:19,985 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125679985 2023-10-01 02:01:19,986 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33385, tgtDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125679985, rawTgtDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125679985, srcFsUri=hdfs://localhost:33385, srcDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae 2023-10-01 02:01:20,044 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33385, inputRoot=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae 2023-10-01 02:01:20,044 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_253649695_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125679985, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125679985/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-01 02:01:20,044 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33385, inputRoot=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae, snapshotDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-10-01 02:01:20,076 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125679985/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-01 02:01:20,552 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:20,553 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:20,554 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:20,555 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:21,375 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/hadoop-1586322623190260521.jar 2023-10-01 02:01:21,375 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:21,376 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:21,434 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/hadoop-1191183239578067519.jar 2023-10-01 02:01:21,434 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:21,435 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:21,435 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:21,436 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:21,436 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:21,437 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:21,437 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 02:01:21,438 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 02:01:21,438 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 02:01:21,439 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 02:01:21,439 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 02:01:21,440 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 02:01:21,440 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 02:01:21,440 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 02:01:21,441 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 02:01:21,441 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 02:01:21,445 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:01:21,445 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:01:21,446 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 02:01:21,446 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:01:21,446 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:01:21,447 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 02:01:21,447 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 02:01:23,077 WARN [Listener at jenkins-hbase17.apache.org/41447] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 02:01:23,084 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-10-01 02:01:23,096 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-01 02:01:23,170 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 02:01:23,582 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 02:01:23,582 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 02:01:23,898 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0001_000001 (auth:SIMPLE) 2023-10-01 02:01:28,403 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0001_000001 (auth:SIMPLE) 2023-10-01 02:01:30,635 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0001_000001 (auth:SIMPLE) 2023-10-01 02:01:33,200 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0001_000001 (auth:SIMPLE) 2023-10-01 02:01:35,009 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 02:01:35,013 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 02:01:35,024 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-10-01 02:01:35,024 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 02:01:35,025 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 02:01:35,025 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-403693088_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-01 02:01:35,026 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-10-01 02:01:35,026 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-10-01 02:01:35,026 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-403693088_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125679985/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125679985/.hbase-snapshot/testExportWithTargetName 2023-10-01 02:01:35,026 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125679985/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-10-01 02:01:35,026 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125679985/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-10-01 02:01:35,039 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-10-01 02:01:35,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportWithTargetName 2023-10-01 02:01:35,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-10-01 02:01:35,056 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125695056"}]},"ts":"1696125695056"} 2023-10-01 02:01:35,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-01 02:01:35,059 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-10-01 02:01:35,061 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-10-01 02:01:35,063 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4a722c90a030a191abf822734e92a802, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a3acf78910c0156ef618e27a13065ef7, UNASSIGN}] 2023-10-01 02:01:35,065 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a3acf78910c0156ef618e27a13065ef7, UNASSIGN 2023-10-01 02:01:35,065 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4a722c90a030a191abf822734e92a802, UNASSIGN 2023-10-01 02:01:35,066 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=4a722c90a030a191abf822734e92a802, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:35,066 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=a3acf78910c0156ef618e27a13065ef7, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:35,066 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696125695066"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125695066"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125695066"}]},"ts":"1696125695066"} 2023-10-01 02:01:35,066 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696125695066"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125695066"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125695066"}]},"ts":"1696125695066"} 2023-10-01 02:01:35,068 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure a3acf78910c0156ef618e27a13065ef7, server=jenkins-hbase17.apache.org,44975,1696125669240}] 2023-10-01 02:01:35,071 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 4a722c90a030a191abf822734e92a802, server=jenkins-hbase17.apache.org,43503,1696125669195}] 2023-10-01 02:01:35,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-01 02:01:35,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close a3acf78910c0156ef618e27a13065ef7 2023-10-01 02:01:35,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 4a722c90a030a191abf822734e92a802 2023-10-01 02:01:35,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing a3acf78910c0156ef618e27a13065ef7, disabling compactions & flushes 2023-10-01 02:01:35,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 4a722c90a030a191abf822734e92a802, disabling compactions & flushes 2023-10-01 02:01:35,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7. 2023-10-01 02:01:35,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802. 2023-10-01 02:01:35,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7. 2023-10-01 02:01:35,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802. 2023-10-01 02:01:35,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7. after waiting 0 ms 2023-10-01 02:01:35,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802. after waiting 0 ms 2023-10-01 02:01:35,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7. 2023-10-01 02:01:35,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802. 2023-10-01 02:01:35,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportWithTargetName/a3acf78910c0156ef618e27a13065ef7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 02:01:35,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportWithTargetName/4a722c90a030a191abf822734e92a802/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 02:01:35,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 02:01:35,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 02:01:35,255 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802. 2023-10-01 02:01:35,255 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7. 2023-10-01 02:01:35,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 4a722c90a030a191abf822734e92a802: 2023-10-01 02:01:35,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for a3acf78910c0156ef618e27a13065ef7: 2023-10-01 02:01:35,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 4a722c90a030a191abf822734e92a802 2023-10-01 02:01:35,258 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=4a722c90a030a191abf822734e92a802, regionState=CLOSED 2023-10-01 02:01:35,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed a3acf78910c0156ef618e27a13065ef7 2023-10-01 02:01:35,259 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696125695258"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125695258"}]},"ts":"1696125695258"} 2023-10-01 02:01:35,263 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=a3acf78910c0156ef618e27a13065ef7, regionState=CLOSED 2023-10-01 02:01:35,263 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696125695262"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125695262"}]},"ts":"1696125695262"} 2023-10-01 02:01:35,264 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=22 2023-10-01 02:01:35,264 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 4a722c90a030a191abf822734e92a802, server=jenkins-hbase17.apache.org,43503,1696125669195 in 190 msec 2023-10-01 02:01:35,266 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4a722c90a030a191abf822734e92a802, UNASSIGN in 202 msec 2023-10-01 02:01:35,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-10-01 02:01:35,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure a3acf78910c0156ef618e27a13065ef7, server=jenkins-hbase17.apache.org,44975,1696125669240 in 197 msec 2023-10-01 02:01:35,269 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-10-01 02:01:35,269 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a3acf78910c0156ef618e27a13065ef7, UNASSIGN in 205 msec 2023-10-01 02:01:35,270 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125695270"}]},"ts":"1696125695270"} 2023-10-01 02:01:35,272 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-10-01 02:01:35,274 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-10-01 02:01:35,278 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 229 msec 2023-10-01 02:01:35,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-01 02:01:35,361 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-10-01 02:01:35,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportWithTargetName 2023-10-01 02:01:35,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 02:01:35,377 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 02:01:35,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-10-01 02:01:35,380 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 02:01:35,384 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45065] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-10-01 02:01:35,386 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 02:01:35,386 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 02:01:35,386 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 02:01:35,386 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 02:01:35,387 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:01:35,387 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:01:35,387 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-01 02:01:35,388 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-01 02:01:35,388 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:01:35,388 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-01 02:01:35,388 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-01 02:01:35,387 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:01:35,388 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-01 02:01:35,388 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-01 02:01:35,388 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-01 02:01:35,388 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-01 02:01:35,389 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportWithTargetName/4a722c90a030a191abf822734e92a802 2023-10-01 02:01:35,389 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportWithTargetName/a3acf78910c0156ef618e27a13065ef7 2023-10-01 02:01:35,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-01 02:01:35,392 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportWithTargetName/a3acf78910c0156ef618e27a13065ef7/cf, FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportWithTargetName/a3acf78910c0156ef618e27a13065ef7/recovered.edits] 2023-10-01 02:01:35,392 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportWithTargetName/4a722c90a030a191abf822734e92a802/cf, FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportWithTargetName/4a722c90a030a191abf822734e92a802/recovered.edits] 2023-10-01 02:01:35,402 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportWithTargetName/4a722c90a030a191abf822734e92a802/cf/e96eaa1372884b57b48b622fb80a8b69 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportWithTargetName/4a722c90a030a191abf822734e92a802/cf/e96eaa1372884b57b48b622fb80a8b69 2023-10-01 02:01:35,402 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportWithTargetName/a3acf78910c0156ef618e27a13065ef7/cf/f1c7ffff84514db5b652ba4f610cb990 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportWithTargetName/a3acf78910c0156ef618e27a13065ef7/cf/f1c7ffff84514db5b652ba4f610cb990 2023-10-01 02:01:35,407 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportWithTargetName/a3acf78910c0156ef618e27a13065ef7/recovered.edits/9.seqid to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportWithTargetName/a3acf78910c0156ef618e27a13065ef7/recovered.edits/9.seqid 2023-10-01 02:01:35,408 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportWithTargetName/4a722c90a030a191abf822734e92a802/recovered.edits/9.seqid to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportWithTargetName/4a722c90a030a191abf822734e92a802/recovered.edits/9.seqid 2023-10-01 02:01:35,408 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportWithTargetName/a3acf78910c0156ef618e27a13065ef7 2023-10-01 02:01:35,408 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportWithTargetName/4a722c90a030a191abf822734e92a802 2023-10-01 02:01:35,408 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-01 02:01:35,409 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-01 02:01:35,410 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-10-01 02:01:35,415 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231001b955aeffea3246f89caead365c651c55 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231001b955aeffea3246f89caead365c651c55 2023-10-01 02:01:35,417 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231001a15cca2b655b456681f4d42fa6a708e6 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231001a15cca2b655b456681f4d42fa6a708e6 2023-10-01 02:01:35,418 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-01 02:01:35,422 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 02:01:35,456 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-10-01 02:01:35,459 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-10-01 02:01:35,461 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 02:01:35,461 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-10-01 02:01:35,462 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696125695461"}]},"ts":"9223372036854775807"} 2023-10-01 02:01:35,462 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696125695461"}]},"ts":"9223372036854775807"} 2023-10-01 02:01:35,464 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 02:01:35,464 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4a722c90a030a191abf822734e92a802, NAME => 'testtb-testExportWithTargetName,,1696125677155.4a722c90a030a191abf822734e92a802.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a3acf78910c0156ef618e27a13065ef7, NAME => 'testtb-testExportWithTargetName,1,1696125677155.a3acf78910c0156ef618e27a13065ef7.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 02:01:35,465 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-10-01 02:01:35,465 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696125695465"}]},"ts":"9223372036854775807"} 2023-10-01 02:01:35,467 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-10-01 02:01:35,470 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 02:01:35,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 103 msec 2023-10-01 02:01:35,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-01 02:01:35,495 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-10-01 02:01:35,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportWithTargetName" 2023-10-01 02:01:35,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-10-01 02:01:35,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportWithTargetName" 2023-10-01 02:01:35,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportWithTargetName 2023-10-01 02:01:35,557 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=755 (was 709) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-403693088_17 at /127.0.0.1:45640 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1844555744_1 at /127.0.0.1:34612 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-403693088_17 at /127.0.0.1:34646 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/cluster_33985e5d-e43f-94f3-71d6-02862cb1aecc/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1111612899) connection to jenkins-hbase17.apache.org/136.243.18.41:44137 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1111612899) connection to jenkins-hbase17.apache.org/136.243.18.41:42153 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1111612899) connection to jenkins-hbase17.apache.org/136.243.18.41:46087 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/cluster_33985e5d-e43f-94f3-71d6-02862cb1aecc/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74c15b32-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1285 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1844555744_1 at /127.0.0.1:42912 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74c15b32-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/cluster_33985e5d-e43f-94f3-71d6-02862cb1aecc/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/cluster_33985e5d-e43f-94f3-71d6-02862cb1aecc/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-403693088_17 at /127.0.0.1:42938 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/cluster_33985e5d-e43f-94f3-71d6-02862cb1aecc/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74c15b32-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74c15b32-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/cluster_33985e5d-e43f-94f3-71d6-02862cb1aecc/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=925 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=389 (was 376) - SystemLoadAverage LEAK? -, ProcessCount=178 (was 178), AvailableMemoryMB=8959 (was 9617) 2023-10-01 02:01:35,557 WARN [Listener at jenkins-hbase17.apache.org/41447] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-10-01 02:01:35,576 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=925, MaxFileDescriptor=60000, SystemLoadAverage=389, ProcessCount=178, AvailableMemoryMB=8958 2023-10-01 02:01:35,576 WARN [Listener at jenkins-hbase17.apache.org/41447] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-10-01 02:01:35,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 02:01:35,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-10-01 02:01:35,585 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 02:01:35,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-10-01 02:01:35,588 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 02:01:35,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-01 02:01:35,591 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemState/485fac74c8d579c4cf0dd5339fe3c9d5 2023-10-01 02:01:35,591 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemState/e4d35fad30f0f4090fc6d3874de58b19 2023-10-01 02:01:35,592 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemState/e4d35fad30f0f4090fc6d3874de58b19 empty. 2023-10-01 02:01:35,592 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemState/485fac74c8d579c4cf0dd5339fe3c9d5 empty. 2023-10-01 02:01:35,592 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemState/e4d35fad30f0f4090fc6d3874de58b19 2023-10-01 02:01:35,592 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemState/485fac74c8d579c4cf0dd5339fe3c9d5 2023-10-01 02:01:35,593 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-01 02:01:35,609 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-01 02:01:35,610 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 485fac74c8d579c4cf0dd5339fe3c9d5, NAME => 'testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp 2023-10-01 02:01:35,610 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => e4d35fad30f0f4090fc6d3874de58b19, NAME => 'testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp 2023-10-01 02:01:35,640 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:01:35,641 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 485fac74c8d579c4cf0dd5339fe3c9d5, disabling compactions & flushes 2023-10-01 02:01:35,641 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5. 2023-10-01 02:01:35,641 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5. 2023-10-01 02:01:35,641 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5. after waiting 0 ms 2023-10-01 02:01:35,641 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5. 2023-10-01 02:01:35,641 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5. 2023-10-01 02:01:35,641 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 485fac74c8d579c4cf0dd5339fe3c9d5: 2023-10-01 02:01:35,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-01 02:01:35,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-01 02:01:36,038 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:01:36,038 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing e4d35fad30f0f4090fc6d3874de58b19, disabling compactions & flushes 2023-10-01 02:01:36,038 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19. 2023-10-01 02:01:36,038 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19. 2023-10-01 02:01:36,038 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19. after waiting 0 ms 2023-10-01 02:01:36,038 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19. 2023-10-01 02:01:36,039 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19. 2023-10-01 02:01:36,039 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for e4d35fad30f0f4090fc6d3874de58b19: 2023-10-01 02:01:36,042 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 02:01:36,043 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696125696043"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125696043"}]},"ts":"1696125696043"} 2023-10-01 02:01:36,043 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696125696043"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125696043"}]},"ts":"1696125696043"} 2023-10-01 02:01:36,046 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 02:01:36,047 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 02:01:36,047 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125696047"}]},"ts":"1696125696047"} 2023-10-01 02:01:36,049 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-10-01 02:01:36,051 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-10-01 02:01:36,053 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 02:01:36,053 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 02:01:36,053 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 02:01:36,053 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 02:01:36,053 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=485fac74c8d579c4cf0dd5339fe3c9d5, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e4d35fad30f0f4090fc6d3874de58b19, ASSIGN}] 2023-10-01 02:01:36,057 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=485fac74c8d579c4cf0dd5339fe3c9d5, ASSIGN 2023-10-01 02:01:36,057 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e4d35fad30f0f4090fc6d3874de58b19, ASSIGN 2023-10-01 02:01:36,063 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=485fac74c8d579c4cf0dd5339fe3c9d5, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,45065,1696125669145; forceNewPlan=false, retain=false 2023-10-01 02:01:36,063 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e4d35fad30f0f4090fc6d3874de58b19, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,43503,1696125669195; forceNewPlan=false, retain=false 2023-10-01 02:01:36,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-01 02:01:36,214 INFO [jenkins-hbase17:37789] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 02:01:36,217 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=485fac74c8d579c4cf0dd5339fe3c9d5, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:36,217 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=e4d35fad30f0f4090fc6d3874de58b19, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:36,217 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696125696217"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125696217"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125696217"}]},"ts":"1696125696217"} 2023-10-01 02:01:36,217 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696125696217"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125696217"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125696217"}]},"ts":"1696125696217"} 2023-10-01 02:01:36,220 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 485fac74c8d579c4cf0dd5339fe3c9d5, server=jenkins-hbase17.apache.org,45065,1696125669145}] 2023-10-01 02:01:36,221 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure e4d35fad30f0f4090fc6d3874de58b19, server=jenkins-hbase17.apache.org,43503,1696125669195}] 2023-10-01 02:01:36,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19. 2023-10-01 02:01:36,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e4d35fad30f0f4090fc6d3874de58b19, NAME => 'testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 02:01:36,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19. service=AccessControlService 2023-10-01 02:01:36,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 02:01:36,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState e4d35fad30f0f4090fc6d3874de58b19 2023-10-01 02:01:36,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:01:36,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for e4d35fad30f0f4090fc6d3874de58b19 2023-10-01 02:01:36,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for e4d35fad30f0f4090fc6d3874de58b19 2023-10-01 02:01:36,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5. 2023-10-01 02:01:36,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 485fac74c8d579c4cf0dd5339fe3c9d5, NAME => 'testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 02:01:36,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5. service=AccessControlService 2023-10-01 02:01:36,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 02:01:36,386 INFO [StoreOpener-e4d35fad30f0f4090fc6d3874de58b19-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e4d35fad30f0f4090fc6d3874de58b19 2023-10-01 02:01:36,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 485fac74c8d579c4cf0dd5339fe3c9d5 2023-10-01 02:01:36,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:01:36,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 485fac74c8d579c4cf0dd5339fe3c9d5 2023-10-01 02:01:36,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 485fac74c8d579c4cf0dd5339fe3c9d5 2023-10-01 02:01:36,387 INFO [StoreOpener-485fac74c8d579c4cf0dd5339fe3c9d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 485fac74c8d579c4cf0dd5339fe3c9d5 2023-10-01 02:01:36,387 DEBUG [StoreOpener-e4d35fad30f0f4090fc6d3874de58b19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemState/e4d35fad30f0f4090fc6d3874de58b19/cf 2023-10-01 02:01:36,387 DEBUG [StoreOpener-e4d35fad30f0f4090fc6d3874de58b19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemState/e4d35fad30f0f4090fc6d3874de58b19/cf 2023-10-01 02:01:36,430 INFO [StoreOpener-e4d35fad30f0f4090fc6d3874de58b19-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4d35fad30f0f4090fc6d3874de58b19 columnFamilyName cf 2023-10-01 02:01:36,432 DEBUG [StoreOpener-485fac74c8d579c4cf0dd5339fe3c9d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemState/485fac74c8d579c4cf0dd5339fe3c9d5/cf 2023-10-01 02:01:36,432 DEBUG [StoreOpener-485fac74c8d579c4cf0dd5339fe3c9d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemState/485fac74c8d579c4cf0dd5339fe3c9d5/cf 2023-10-01 02:01:36,432 INFO [StoreOpener-e4d35fad30f0f4090fc6d3874de58b19-1] regionserver.HStore(310): Store=e4d35fad30f0f4090fc6d3874de58b19/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 02:01:36,434 INFO [StoreOpener-485fac74c8d579c4cf0dd5339fe3c9d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 485fac74c8d579c4cf0dd5339fe3c9d5 columnFamilyName cf 2023-10-01 02:01:36,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemState/e4d35fad30f0f4090fc6d3874de58b19 2023-10-01 02:01:36,435 INFO [StoreOpener-485fac74c8d579c4cf0dd5339fe3c9d5-1] regionserver.HStore(310): Store=485fac74c8d579c4cf0dd5339fe3c9d5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 02:01:36,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemState/e4d35fad30f0f4090fc6d3874de58b19 2023-10-01 02:01:36,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemState/485fac74c8d579c4cf0dd5339fe3c9d5 2023-10-01 02:01:36,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemState/485fac74c8d579c4cf0dd5339fe3c9d5 2023-10-01 02:01:36,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for e4d35fad30f0f4090fc6d3874de58b19 2023-10-01 02:01:36,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 485fac74c8d579c4cf0dd5339fe3c9d5 2023-10-01 02:01:36,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemState/e4d35fad30f0f4090fc6d3874de58b19/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 02:01:36,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened e4d35fad30f0f4090fc6d3874de58b19; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59647482, jitterRate=-0.11118325591087341}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 02:01:36,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for e4d35fad30f0f4090fc6d3874de58b19: 2023-10-01 02:01:36,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemState/485fac74c8d579c4cf0dd5339fe3c9d5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 02:01:36,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 485fac74c8d579c4cf0dd5339fe3c9d5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66107641, jitterRate=-0.014919385313987732}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 02:01:36,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19., pid=31, masterSystemTime=1696125696374 2023-10-01 02:01:36,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 485fac74c8d579c4cf0dd5339fe3c9d5: 2023-10-01 02:01:36,445 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5., pid=30, masterSystemTime=1696125696373 2023-10-01 02:01:36,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19. 2023-10-01 02:01:36,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19. 2023-10-01 02:01:36,448 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=e4d35fad30f0f4090fc6d3874de58b19, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:36,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5. 2023-10-01 02:01:36,448 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5. 2023-10-01 02:01:36,448 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696125696448"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696125696448"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696125696448"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696125696448"}]},"ts":"1696125696448"} 2023-10-01 02:01:36,449 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=485fac74c8d579c4cf0dd5339fe3c9d5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:36,450 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696125696449"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696125696449"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696125696449"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696125696449"}]},"ts":"1696125696449"} 2023-10-01 02:01:36,455 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-10-01 02:01:36,457 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure e4d35fad30f0f4090fc6d3874de58b19, server=jenkins-hbase17.apache.org,43503,1696125669195 in 230 msec 2023-10-01 02:01:36,459 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-10-01 02:01:36,462 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e4d35fad30f0f4090fc6d3874de58b19, ASSIGN in 402 msec 2023-10-01 02:01:36,462 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 485fac74c8d579c4cf0dd5339fe3c9d5, server=jenkins-hbase17.apache.org,45065,1696125669145 in 233 msec 2023-10-01 02:01:36,467 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-10-01 02:01:36,467 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=485fac74c8d579c4cf0dd5339fe3c9d5, ASSIGN in 409 msec 2023-10-01 02:01:36,468 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 02:01:36,469 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125696468"}]},"ts":"1696125696468"} 2023-10-01 02:01:36,471 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-10-01 02:01:36,473 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 02:01:36,474 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-10-01 02:01:36,477 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45065] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 02:01:36,478 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:01:36,478 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:01:36,478 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:01:36,478 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:01:36,479 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 02:01:36,479 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 02:01:36,479 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 02:01:36,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 02:01:36,482 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 900 msec 2023-10-01 02:01:36,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-01 02:01:36,697 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-10-01 02:01:36,701 DEBUG [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-01 02:01:36,701 DEBUG [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5. 2023-10-01 02:01:36,704 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 02:01:36,718 DEBUG [hconnection-0x5f6898f7-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:01:36,724 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59720, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:01:36,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 02:01:36,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696125696730 (current time:1696125696730). 2023-10-01 02:01:36,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 02:01:36,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(139): Connect 0x7eb5c0ae to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:01:36,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ff008d7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:01:36,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:01:36,747 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:33732, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:01:36,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7eb5c0ae to 127.0.0.1:51733 2023-10-01 02:01:36,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:01:36,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(139): Connect 0x0dd4d744 to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:01:36,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d34d6e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:01:36,762 DEBUG [hconnection-0x32eddb21-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:01:36,766 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:33740, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:01:36,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:01:36,773 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:01:36,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0dd4d744 to 127.0.0.1:51733 2023-10-01 02:01:36,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:01:36,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 02:01:36,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 02:01:36,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 02:01:36,781 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot, current working dir path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 02:01:36,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 02:01:36,785 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 02:01:36,787 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696126296787 2023-10-01 02:01:36,787 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-01 02:01:36,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 02:01:36,791 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 02:01:36,791 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 02:01:36,791 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 02:01:36,793 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 02:01:36,801 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-10-01 02:01:36,803 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 02:01:36,804 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696126296804 2023-10-01 02:01:36,828 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,828 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-10-01 02:01:36,828 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:01:36,830 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-10-01 02:01:36,830 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-01 02:01:36,877 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,877 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,878 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:36,878 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:36,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:36,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:36,878 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:36,878 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:36,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:36,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:36,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:36,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:36,879 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:36,879 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:36,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,879 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:36,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,879 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 02:01:36,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-01 02:01:36,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-01 02:01:36,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-01 02:01:36,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,881 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 02:01:36,881 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 02:01:36,881 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 02:01:36,881 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,881 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,881 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 02:01:36,881 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 02:01:36,881 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:01:36,881 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:01:36,881 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,884 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 02:01:36,884 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-01 02:01:36,883 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 02:01:36,884 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-01 02:01:36,884 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,43503,1696125669195' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-01 02:01:36,884 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44975,1696125669240' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-01 02:01:36,884 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 02:01:36,884 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:01:36,886 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 02:01:36,886 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-01 02:01:36,886 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,45065,1696125669145' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-01 02:01:36,889 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,889 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:36,889 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:36,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:36,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:36,889 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:36,889 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,889 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,889 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,889 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:01:36,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:36,889 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:01:36,889 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,889 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:01:36,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:36,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:36,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:36,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:36,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:36,891 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,43503,1696125669195' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-01 02:01:36,891 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d4de640[Count = 1] remaining members to acquire global barrier 2023-10-01 02:01:36,891 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 02:01:36,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:36,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:36,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:36,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:36,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 02:01:36,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-01 02:01:36,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:36,892 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 02:01:36,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:36,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:36,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:36,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:36,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,45065,1696125669145' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-01 02:01:36,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d4de640[Count = 0] remaining members to acquire global barrier 2023-10-01 02:01:36,894 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-01 02:01:36,894 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,895 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,895 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,895 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,895 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 02:01:36,895 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:36,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,895 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 02:01:36,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,895 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 02:01:36,895 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 02:01:36,895 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-01 02:01:36,895 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5. 2023-10-01 02:01:36,895 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 02:01:36,895 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,44975,1696125669240' in zk 2023-10-01 02:01:36,895 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5. started... 2023-10-01 02:01:36,896 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 485fac74c8d579c4cf0dd5339fe3c9d5: 2023-10-01 02:01:36,896 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:36,896 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 02:01:36,896 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,896 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 02:01:36,896 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 02:01:36,896 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 02:01:36,896 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:01:36,896 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-01 02:01:36,901 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 02:01:36,902 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19. 2023-10-01 02:01:36,902 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 02:01:36,902 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19. started... 2023-10-01 02:01:36,904 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e4d35fad30f0f4090fc6d3874de58b19: 2023-10-01 02:01:36,904 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,904 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 02:01:36,904 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 02:01:36,921 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5. completed. 2023-10-01 02:01:36,921 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5. 2023-10-01 02:01:36,922 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 02:01:36,922 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 02:01:36,922 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:36,922 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-01 02:01:36,922 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,45065,1696125669145' in zk 2023-10-01 02:01:36,923 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 02:01:36,923 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:36,923 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:01:36,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:36,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:36,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:36,923 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-01 02:01:36,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:36,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:36,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:36,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:36,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:36,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:36,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:36,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:36,933 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19. completed. 2023-10-01 02:01:36,934 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19. 2023-10-01 02:01:36,934 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 02:01:36,934 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 02:01:36,934 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:36,934 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-01 02:01:36,934 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,43503,1696125669195' in zk 2023-10-01 02:01:36,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,45065,1696125669145': 2023-10-01 02:01:36,934 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,45065,1696125669145' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-01 02:01:36,935 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:36,935 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 02:01:36,935 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:01:36,935 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-01 02:01:36,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:36,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:36,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:36,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:36,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:36,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:36,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:36,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:36,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:36,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:36,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:36,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:36,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,43503,1696125669195': 2023-10-01 02:01:36,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,43503,1696125669195' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-01 02:01:36,941 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-10-01 02:01:36,941 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 02:01:36,941 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 02:01:36,941 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,941 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 02:01:36,942 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,942 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,942 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,943 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,942 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:36,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:36,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:36,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,943 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:36,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,943 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:36,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:36,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:36,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:36,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:36,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:36,944 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:36,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:36,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:36,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,945 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:36,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:36,945 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:36,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:36,946 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:36,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:36,947 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:36,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:36,947 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:36,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:36,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:36,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:36,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:36,950 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:36,950 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:36,950 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,950 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:36,950 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:36,950 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,950 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:36,951 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:36,951 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:36,951 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,951 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:36,951 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:36,951 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,951 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,951 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-01 02:01:36,950 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:36,951 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,951 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:01:36,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:36,950 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:36,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:36,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:36,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:36,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:36,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:36,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 02:01:36,951 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:36,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:36,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:36,952 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 02:01:36,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:36,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:36,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:36,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:36,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,963 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,987 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,988 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-01 02:01:36,988 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,988 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:36,988 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696125696788Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696125696962 (+174 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1696125696962Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1696125696962Writing data manifest for emptySnaptb0-testExportFileSystemState at 1696125696966 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1696125696978 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696125696988 (+10 ms) 2023-10-01 02:01:36,991 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 02:01:37,003 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 201 msec 2023-10-01 02:01:37,092 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 02:01:37,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 02:01:37,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 02:01:37,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45065] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 02:01:37,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43503] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 02:01:37,105 DEBUG [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-01 02:01:37,106 DEBUG [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5. 2023-10-01 02:01:37,106 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 02:01:37,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 02:01:37,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696125697123 (current time:1696125697123). 2023-10-01 02:01:37,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 02:01:37,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(139): Connect 0x0c4adaaf to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:01:37,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7851c9e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:01:37,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:01:37,141 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:33754, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:01:37,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c4adaaf to 127.0.0.1:51733 2023-10-01 02:01:37,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:01:37,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(139): Connect 0x0a86679c to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:01:37,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26abb6d4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:01:37,158 DEBUG [hconnection-0x740a699e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:01:37,160 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:33766, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:01:37,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:01:37,170 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59728, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:01:37,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a86679c to 127.0.0.1:51733 2023-10-01 02:01:37,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:01:37,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 02:01:37,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 02:01:37,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 02:01:37,177 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot, current working dir path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 02:01:37,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 02:01:37,183 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 02:01:37,186 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696126297186 2023-10-01 02:01:37,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 02:01:37,186 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-01 02:01:37,188 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 02:01:37,188 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 02:01:37,190 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 02:01:37,192 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 02:01:37,195 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 15 msec 2023-10-01 02:01:37,198 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 02:01:37,200 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696126297200 2023-10-01 02:01:37,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-10-01 02:01:37,214 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-10-01 02:01:37,214 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:01:37,216 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-10-01 02:01:37,216 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-01 02:01:37,216 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,216 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,217 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:37,217 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:37,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:37,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:37,217 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:37,217 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:37,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:37,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:37,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:37,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:37,218 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:37,218 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:37,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,218 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,218 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,218 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:37,218 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 02:01:37,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-01 02:01:37,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,219 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 02:01:37,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-01 02:01:37,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,219 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-01 02:01:37,219 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 02:01:37,219 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 02:01:37,219 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:01:37,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-01 02:01:37,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,221 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-01 02:01:37,221 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 02:01:37,221 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 02:01:37,221 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 02:01:37,221 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:01:37,221 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-01 02:01:37,222 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 02:01:37,222 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-01 02:01:37,222 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-01 02:01:37,222 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 02:01:37,222 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,45065,1696125669145' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-01 02:01:37,222 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:01:37,222 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,43503,1696125669195' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-01 02:01:37,223 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 02:01:37,224 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-01 02:01:37,224 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44975,1696125669240' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-01 02:01:37,225 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,225 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:37,225 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:37,225 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,225 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,225 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,226 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:01:37,226 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,226 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:01:37,226 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:37,226 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:01:37,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:37,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 02:01:37,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:37,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:37,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:37,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:37,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,43503,1696125669195' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-01 02:01:37,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29f847d1[Count = 1] remaining members to acquire global barrier 2023-10-01 02:01:37,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:37,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:37,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:37,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:37,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:37,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 02:01:37,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:37,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:37,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:37,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:37,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,45065,1696125669145' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-01 02:01:37,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29f847d1[Count = 0] remaining members to acquire global barrier 2023-10-01 02:01:37,230 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-01 02:01:37,230 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,231 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,231 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,231 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:37,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,231 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,232 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 02:01:37,232 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 02:01:37,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,232 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 02:01:37,232 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-01 02:01:37,232 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 02:01:37,232 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 02:01:37,232 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,44975,1696125669240' in zk 2023-10-01 02:01:37,232 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19. 2023-10-01 02:01:37,232 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:37,232 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19. started... 2023-10-01 02:01:37,232 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 02:01:37,232 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 02:01:37,232 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 02:01:37,232 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5. 2023-10-01 02:01:37,233 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5. started... 2023-10-01 02:01:37,233 INFO [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 485fac74c8d579c4cf0dd5339fe3c9d5 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-01 02:01:37,233 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 02:01:37,233 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:01:37,233 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-01 02:01:37,235 INFO [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e4d35fad30f0f4090fc6d3874de58b19 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-01 02:01:37,288 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 02:01:37,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 02:01:37,291 INFO [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231001c0dffd25148a4088bd090864500aab32 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231001c0dffd25148a4088bd090864500aab32 2023-10-01 02:01:37,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-01 02:01:37,292 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 02:01:37,305 INFO [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemState/e4d35fad30f0f4090fc6d3874de58b19/.tmp/cf/3781f52aa9d44884abe64dafd8773483 2023-10-01 02:01:37,313 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemState/e4d35fad30f0f4090fc6d3874de58b19/.tmp/cf/3781f52aa9d44884abe64dafd8773483 as hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemState/e4d35fad30f0f4090fc6d3874de58b19/cf/3781f52aa9d44884abe64dafd8773483 2023-10-01 02:01:37,320 INFO [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemState/e4d35fad30f0f4090fc6d3874de58b19/cf/3781f52aa9d44884abe64dafd8773483, entries=46, sequenceid=6, filesize=12.7 K 2023-10-01 02:01:37,322 INFO [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for e4d35fad30f0f4090fc6d3874de58b19 in 89ms, sequenceid=6, compaction requested=false 2023-10-01 02:01:37,322 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-10-01 02:01:37,322 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e4d35fad30f0f4090fc6d3874de58b19: 2023-10-01 02:01:37,322 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-01 02:01:37,323 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 02:01:37,323 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemState/e4d35fad30f0f4090fc6d3874de58b19/cf/3781f52aa9d44884abe64dafd8773483] hfiles 2023-10-01 02:01:37,323 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemState/e4d35fad30f0f4090fc6d3874de58b19/cf/3781f52aa9d44884abe64dafd8773483 for snapshot=snaptb0-testExportFileSystemState 2023-10-01 02:01:37,334 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19. completed. 2023-10-01 02:01:37,334 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19. 2023-10-01 02:01:37,334 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 02:01:37,334 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 02:01:37,334 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:37,334 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-01 02:01:37,335 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,43503,1696125669195' in zk 2023-10-01 02:01:37,337 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 02:01:37,337 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:01:37,337 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:37,337 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-01 02:01:37,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:37,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:37,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:37,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:37,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:37,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 02:01:37,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:37,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:37,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:37,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:37,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 02:01:37,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:37,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:37,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,43503,1696125669195': 2023-10-01 02:01:37,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,43503,1696125669195' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-01 02:01:37,492 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 02:01:37,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 02:01:37,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-01 02:01:37,493 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-01 02:01:37,689 INFO [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023100177e5732a71dd445a919b8b33cb47326c to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100177e5732a71dd445a919b8b33cb47326c 2023-10-01 02:01:37,698 INFO [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemState/485fac74c8d579c4cf0dd5339fe3c9d5/.tmp/cf/081051c49e754816b71429aa1dbefbe5 2023-10-01 02:01:37,704 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemState/485fac74c8d579c4cf0dd5339fe3c9d5/.tmp/cf/081051c49e754816b71429aa1dbefbe5 as hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemState/485fac74c8d579c4cf0dd5339fe3c9d5/cf/081051c49e754816b71429aa1dbefbe5 2023-10-01 02:01:37,711 INFO [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemState/485fac74c8d579c4cf0dd5339fe3c9d5/cf/081051c49e754816b71429aa1dbefbe5, entries=4, sequenceid=6, filesize=5.6 K 2023-10-01 02:01:37,712 INFO [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 485fac74c8d579c4cf0dd5339fe3c9d5 in 479ms, sequenceid=6, compaction requested=false 2023-10-01 02:01:37,713 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 485fac74c8d579c4cf0dd5339fe3c9d5: 2023-10-01 02:01:37,714 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-01 02:01:37,714 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 02:01:37,714 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemState/485fac74c8d579c4cf0dd5339fe3c9d5/cf/081051c49e754816b71429aa1dbefbe5] hfiles 2023-10-01 02:01:37,714 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemState/485fac74c8d579c4cf0dd5339fe3c9d5/cf/081051c49e754816b71429aa1dbefbe5 for snapshot=snaptb0-testExportFileSystemState 2023-10-01 02:01:37,722 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5. completed. 2023-10-01 02:01:37,722 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5. 2023-10-01 02:01:37,722 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 02:01:37,722 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 02:01:37,722 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:37,722 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-01 02:01:37,722 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,45065,1696125669145' in zk 2023-10-01 02:01:37,724 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 02:01:37,724 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:37,724 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:01:37,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:37,724 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-01 02:01:37,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:37,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:37,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:37,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:37,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 02:01:37,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:37,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:37,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:37,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:37,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 02:01:37,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:37,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:37,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:37,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,45065,1696125669145': 2023-10-01 02:01:37,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,45065,1696125669145' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-01 02:01:37,729 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-10-01 02:01:37,729 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 02:01:37,729 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 02:01:37,729 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-10-01 02:01:37,729 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 02:01:37,730 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,730 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,730 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:37,730 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:37,730 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,730 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,731 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:37,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:37,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:37,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:37,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:37,731 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:37,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:37,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:37,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:37,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:37,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:37,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,732 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:37,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 02:01:37,732 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:37,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:37,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 02:01:37,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:37,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:37,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:37,734 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:37,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:37,734 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:37,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 02:01:37,735 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:37,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:37,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:37,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:37,737 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:37,737 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:37,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:37,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:37,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:37,737 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:37,737 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:37,738 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:37,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:37,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:37,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:37,738 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:01:37,738 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:37,738 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-10-01 02:01:37,739 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:37,739 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,739 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:37,739 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:37,739 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:37,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:37,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:37,739 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-01 02:01:37,740 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-01 02:01:37,740 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 02:01:37,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:37,739 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:37,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:37,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:37,741 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231001c0dffd25148a4088bd090864500aab32, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100177e5732a71dd445a919b8b33cb47326c] mob files 2023-10-01 02:01:37,741 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,741 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:37,741 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231001c0dffd25148a4088bd090864500aab32 2023-10-01 02:01:37,741 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:37,741 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100177e5732a71dd445a919b8b33cb47326c 2023-10-01 02:01:37,741 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,742 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,775 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-10-01 02:01:37,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,794 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 02:01:37,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 02:01:37,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-01 02:01:37,795 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-01 02:01:37,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,800 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-01 02:01:37,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,800 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-01 02:01:37,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696125697186Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696125697775 (+589 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1696125697775Loading Region manifests for snaptb0-testExportFileSystemState at 1696125697775Writing data manifest for snaptb0-testExportFileSystemState at 1696125697779 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1696125697790 (+11 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696125697800 (+10 ms) 2023-10-01 02:01:37,803 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 02:01:37,805 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 615 msec 2023-10-01 02:01:38,295 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 02:01:38,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 02:01:38,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 02:01:38,297 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125698297 2023-10-01 02:01:38,297 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33385, tgtDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125698297, rawTgtDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125698297, srcFsUri=hdfs://localhost:33385, srcDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae 2023-10-01 02:01:38,320 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33385, inputRoot=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae 2023-10-01 02:01:38,320 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1983268635_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125698297, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125698297/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-01 02:01:38,320 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33385, inputRoot=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae, snapshotDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-10-01 02:01:38,340 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125698297/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-01 02:01:38,385 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:38,386 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:38,387 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:38,387 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:39,143 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/hadoop-7898967409678159436.jar 2023-10-01 02:01:39,143 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:39,144 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:39,206 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/hadoop-318766766869049434.jar 2023-10-01 02:01:39,206 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:39,206 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:39,207 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:39,207 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:39,207 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:39,208 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:39,208 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 02:01:39,209 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 02:01:39,209 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 02:01:39,210 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 02:01:39,210 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 02:01:39,211 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 02:01:39,211 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 02:01:39,211 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 02:01:39,212 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 02:01:39,212 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 02:01:39,213 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:01:39,213 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:01:39,213 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 02:01:39,214 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:01:39,214 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:01:39,214 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 02:01:39,215 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 02:01:39,431 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0001_000001 (auth:SIMPLE) 2023-10-01 02:01:39,773 WARN [Listener at jenkins-hbase17.apache.org/41447] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 02:01:39,776 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-10-01 02:01:39,778 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-01 02:01:39,867 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 02:01:39,867 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 02:01:40,076 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0002_000001 (auth:SIMPLE) 2023-10-01 02:01:40,851 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 02:01:43,873 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0002_000001 (auth:SIMPLE) 2023-10-01 02:01:46,075 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0002_000001 (auth:SIMPLE) 2023-10-01 02:01:48,336 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0002_000001 (auth:SIMPLE) 2023-10-01 02:01:50,070 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 02:01:50,071 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 02:01:50,080 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-10-01 02:01:50,080 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 02:01:50,080 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 02:01:50,080 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-403693088_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-01 02:01:50,081 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-01 02:01:50,081 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-01 02:01:50,081 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-403693088_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125698297/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125698297/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-01 02:01:50,081 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125698297/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-01 02:01:50,082 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125698297/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-01 02:01:50,088 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-10-01 02:01:50,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemState 2023-10-01 02:01:50,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-10-01 02:01:50,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-01 02:01:50,094 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125710094"}]},"ts":"1696125710094"} 2023-10-01 02:01:50,095 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-10-01 02:01:50,097 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-10-01 02:01:50,098 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=485fac74c8d579c4cf0dd5339fe3c9d5, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e4d35fad30f0f4090fc6d3874de58b19, UNASSIGN}] 2023-10-01 02:01:50,100 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=485fac74c8d579c4cf0dd5339fe3c9d5, UNASSIGN 2023-10-01 02:01:50,100 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e4d35fad30f0f4090fc6d3874de58b19, UNASSIGN 2023-10-01 02:01:50,102 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e4d35fad30f0f4090fc6d3874de58b19, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:50,102 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=485fac74c8d579c4cf0dd5339fe3c9d5, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:50,102 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696125710102"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125710102"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125710102"}]},"ts":"1696125710102"} 2023-10-01 02:01:50,102 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696125710102"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125710102"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125710102"}]},"ts":"1696125710102"} 2023-10-01 02:01:50,104 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure e4d35fad30f0f4090fc6d3874de58b19, server=jenkins-hbase17.apache.org,43503,1696125669195}] 2023-10-01 02:01:50,105 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 485fac74c8d579c4cf0dd5339fe3c9d5, server=jenkins-hbase17.apache.org,45065,1696125669145}] 2023-10-01 02:01:50,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-01 02:01:50,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close e4d35fad30f0f4090fc6d3874de58b19 2023-10-01 02:01:50,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 485fac74c8d579c4cf0dd5339fe3c9d5 2023-10-01 02:01:50,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing e4d35fad30f0f4090fc6d3874de58b19, disabling compactions & flushes 2023-10-01 02:01:50,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19. 2023-10-01 02:01:50,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 485fac74c8d579c4cf0dd5339fe3c9d5, disabling compactions & flushes 2023-10-01 02:01:50,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19. 2023-10-01 02:01:50,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5. 2023-10-01 02:01:50,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5. 2023-10-01 02:01:50,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5. after waiting 0 ms 2023-10-01 02:01:50,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5. 2023-10-01 02:01:50,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19. after waiting 0 ms 2023-10-01 02:01:50,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19. 2023-10-01 02:01:50,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemState/e4d35fad30f0f4090fc6d3874de58b19/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 02:01:50,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemState/485fac74c8d579c4cf0dd5339fe3c9d5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 02:01:50,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 02:01:50,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 02:01:50,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19. 2023-10-01 02:01:50,270 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5. 2023-10-01 02:01:50,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 485fac74c8d579c4cf0dd5339fe3c9d5: 2023-10-01 02:01:50,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for e4d35fad30f0f4090fc6d3874de58b19: 2023-10-01 02:01:50,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 485fac74c8d579c4cf0dd5339fe3c9d5 2023-10-01 02:01:50,272 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=485fac74c8d579c4cf0dd5339fe3c9d5, regionState=CLOSED 2023-10-01 02:01:50,272 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696125710272"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125710272"}]},"ts":"1696125710272"} 2023-10-01 02:01:50,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed e4d35fad30f0f4090fc6d3874de58b19 2023-10-01 02:01:50,273 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e4d35fad30f0f4090fc6d3874de58b19, regionState=CLOSED 2023-10-01 02:01:50,273 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696125710273"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125710273"}]},"ts":"1696125710273"} 2023-10-01 02:01:50,277 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=37 2023-10-01 02:01:50,277 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 485fac74c8d579c4cf0dd5339fe3c9d5, server=jenkins-hbase17.apache.org,45065,1696125669145 in 169 msec 2023-10-01 02:01:50,278 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=38 2023-10-01 02:01:50,278 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure e4d35fad30f0f4090fc6d3874de58b19, server=jenkins-hbase17.apache.org,43503,1696125669195 in 171 msec 2023-10-01 02:01:50,278 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=485fac74c8d579c4cf0dd5339fe3c9d5, UNASSIGN in 179 msec 2023-10-01 02:01:50,280 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-10-01 02:01:50,280 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e4d35fad30f0f4090fc6d3874de58b19, UNASSIGN in 180 msec 2023-10-01 02:01:50,280 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125710280"}]},"ts":"1696125710280"} 2023-10-01 02:01:50,282 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-10-01 02:01:50,283 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-10-01 02:01:50,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 195 msec 2023-10-01 02:01:50,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-01 02:01:50,396 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-10-01 02:01:50,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemState 2023-10-01 02:01:50,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 02:01:50,400 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 02:01:50,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-10-01 02:01:50,401 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 02:01:50,402 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45065] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-10-01 02:01:50,404 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 02:01:50,404 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 02:01:50,404 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 02:01:50,405 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-01 02:01:50,405 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-01 02:01:50,405 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-01 02:01:50,405 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 02:01:50,405 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 02:01:50,406 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:01:50,406 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 02:01:50,406 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:01:50,406 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:01:50,406 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 02:01:50,406 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:01:50,406 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-10-01 02:01:50,407 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-01 02:01:50,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-01 02:01:50,407 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemState/485fac74c8d579c4cf0dd5339fe3c9d5 2023-10-01 02:01:50,407 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemState/e4d35fad30f0f4090fc6d3874de58b19 2023-10-01 02:01:50,409 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemState/485fac74c8d579c4cf0dd5339fe3c9d5/cf, FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemState/485fac74c8d579c4cf0dd5339fe3c9d5/recovered.edits] 2023-10-01 02:01:50,409 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemState/e4d35fad30f0f4090fc6d3874de58b19/cf, FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemState/e4d35fad30f0f4090fc6d3874de58b19/recovered.edits] 2023-10-01 02:01:50,413 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemState/485fac74c8d579c4cf0dd5339fe3c9d5/cf/081051c49e754816b71429aa1dbefbe5 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportFileSystemState/485fac74c8d579c4cf0dd5339fe3c9d5/cf/081051c49e754816b71429aa1dbefbe5 2023-10-01 02:01:50,413 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemState/e4d35fad30f0f4090fc6d3874de58b19/cf/3781f52aa9d44884abe64dafd8773483 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportFileSystemState/e4d35fad30f0f4090fc6d3874de58b19/cf/3781f52aa9d44884abe64dafd8773483 2023-10-01 02:01:50,416 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemState/485fac74c8d579c4cf0dd5339fe3c9d5/recovered.edits/9.seqid to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportFileSystemState/485fac74c8d579c4cf0dd5339fe3c9d5/recovered.edits/9.seqid 2023-10-01 02:01:50,416 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemState/e4d35fad30f0f4090fc6d3874de58b19/recovered.edits/9.seqid to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportFileSystemState/e4d35fad30f0f4090fc6d3874de58b19/recovered.edits/9.seqid 2023-10-01 02:01:50,417 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemState/485fac74c8d579c4cf0dd5339fe3c9d5 2023-10-01 02:01:50,417 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemState/e4d35fad30f0f4090fc6d3874de58b19 2023-10-01 02:01:50,417 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-01 02:01:50,417 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-01 02:01:50,418 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-10-01 02:01:50,421 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231001c0dffd25148a4088bd090864500aab32 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231001c0dffd25148a4088bd090864500aab32 2023-10-01 02:01:50,423 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100177e5732a71dd445a919b8b33cb47326c to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100177e5732a71dd445a919b8b33cb47326c 2023-10-01 02:01:50,423 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-01 02:01:50,426 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 02:01:50,428 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-10-01 02:01:50,430 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-10-01 02:01:50,432 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 02:01:50,432 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-10-01 02:01:50,432 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696125710432"}]},"ts":"9223372036854775807"} 2023-10-01 02:01:50,432 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696125710432"}]},"ts":"9223372036854775807"} 2023-10-01 02:01:50,435 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 02:01:50,435 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 485fac74c8d579c4cf0dd5339fe3c9d5, NAME => 'testtb-testExportFileSystemState,,1696125695578.485fac74c8d579c4cf0dd5339fe3c9d5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e4d35fad30f0f4090fc6d3874de58b19, NAME => 'testtb-testExportFileSystemState,1,1696125695578.e4d35fad30f0f4090fc6d3874de58b19.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 02:01:50,435 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-10-01 02:01:50,435 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696125710435"}]},"ts":"9223372036854775807"} 2023-10-01 02:01:50,438 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-10-01 02:01:50,439 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 02:01:50,441 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 42 msec 2023-10-01 02:01:50,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-01 02:01:50,508 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-10-01 02:01:50,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportFileSystemState" 2023-10-01 02:01:50,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-10-01 02:01:50,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemState" 2023-10-01 02:01:50,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemState 2023-10-01 02:01:50,549 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=769 (was 755) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-403693088_17 at /127.0.0.1:54568 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1965 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2135461611_1 at /127.0.0.1:58600 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-403693088_17 at /127.0.0.1:42926 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1111612899) connection to jenkins-hbase17.apache.org/136.243.18.41:41447 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x74c15b32-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74c15b32-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74c15b32-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2135461611_1 at /127.0.0.1:35786 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1111612899) connection to jenkins-hbase17.apache.org/136.243.18.41:35857 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-403693088_17 at /127.0.0.1:54816 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74c15b32-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=937 (was 925) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=353 (was 389), ProcessCount=180 (was 178) - ProcessCount LEAK? -, AvailableMemoryMB=8837 (was 8958) 2023-10-01 02:01:50,549 WARN [Listener at jenkins-hbase17.apache.org/41447] hbase.ResourceChecker(130): Thread=769 is superior to 500 2023-10-01 02:01:50,568 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=769, OpenFileDescriptor=937, MaxFileDescriptor=60000, SystemLoadAverage=353, ProcessCount=180, AvailableMemoryMB=8836 2023-10-01 02:01:50,568 WARN [Listener at jenkins-hbase17.apache.org/41447] hbase.ResourceChecker(130): Thread=769 is superior to 500 2023-10-01 02:01:50,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 02:01:50,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-10-01 02:01:50,575 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 02:01:50,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-10-01 02:01:50,576 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 02:01:50,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-01 02:01:50,579 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testConsecutiveExports/b610ccdb2ef1a9821ea892c02456fcfb 2023-10-01 02:01:50,579 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testConsecutiveExports/8180712ba8f72a70819a5429df6c50c0 2023-10-01 02:01:50,580 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testConsecutiveExports/b610ccdb2ef1a9821ea892c02456fcfb empty. 2023-10-01 02:01:50,580 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testConsecutiveExports/8180712ba8f72a70819a5429df6c50c0 empty. 2023-10-01 02:01:50,580 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testConsecutiveExports/b610ccdb2ef1a9821ea892c02456fcfb 2023-10-01 02:01:50,580 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testConsecutiveExports/8180712ba8f72a70819a5429df6c50c0 2023-10-01 02:01:50,580 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-01 02:01:50,612 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-10-01 02:01:50,614 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8180712ba8f72a70819a5429df6c50c0, NAME => 'testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp 2023-10-01 02:01:50,614 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => b610ccdb2ef1a9821ea892c02456fcfb, NAME => 'testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp 2023-10-01 02:01:50,651 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:01:50,651 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 8180712ba8f72a70819a5429df6c50c0, disabling compactions & flushes 2023-10-01 02:01:50,651 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0. 2023-10-01 02:01:50,651 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0. 2023-10-01 02:01:50,651 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0. after waiting 0 ms 2023-10-01 02:01:50,652 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0. 2023-10-01 02:01:50,652 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0. 2023-10-01 02:01:50,652 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 8180712ba8f72a70819a5429df6c50c0: 2023-10-01 02:01:50,653 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:01:50,653 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing b610ccdb2ef1a9821ea892c02456fcfb, disabling compactions & flushes 2023-10-01 02:01:50,653 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb. 2023-10-01 02:01:50,653 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb. 2023-10-01 02:01:50,654 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb. after waiting 0 ms 2023-10-01 02:01:50,654 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb. 2023-10-01 02:01:50,654 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb. 2023-10-01 02:01:50,654 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for b610ccdb2ef1a9821ea892c02456fcfb: 2023-10-01 02:01:50,657 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 02:01:50,658 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696125710658"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125710658"}]},"ts":"1696125710658"} 2023-10-01 02:01:50,658 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696125710658"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125710658"}]},"ts":"1696125710658"} 2023-10-01 02:01:50,660 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 02:01:50,661 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 02:01:50,661 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125710661"}]},"ts":"1696125710661"} 2023-10-01 02:01:50,663 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-10-01 02:01:50,665 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-10-01 02:01:50,666 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 02:01:50,666 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 02:01:50,666 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 02:01:50,666 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 02:01:50,666 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b610ccdb2ef1a9821ea892c02456fcfb, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8180712ba8f72a70819a5429df6c50c0, ASSIGN}] 2023-10-01 02:01:50,669 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8180712ba8f72a70819a5429df6c50c0, ASSIGN 2023-10-01 02:01:50,670 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b610ccdb2ef1a9821ea892c02456fcfb, ASSIGN 2023-10-01 02:01:50,673 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8180712ba8f72a70819a5429df6c50c0, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,45065,1696125669145; forceNewPlan=false, retain=false 2023-10-01 02:01:50,674 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b610ccdb2ef1a9821ea892c02456fcfb, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,43503,1696125669195; forceNewPlan=false, retain=false 2023-10-01 02:01:50,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-01 02:01:50,824 INFO [jenkins-hbase17:37789] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 02:01:50,827 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=b610ccdb2ef1a9821ea892c02456fcfb, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:50,827 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=8180712ba8f72a70819a5429df6c50c0, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:50,827 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696125710827"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125710827"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125710827"}]},"ts":"1696125710827"} 2023-10-01 02:01:50,827 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696125710827"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125710827"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125710827"}]},"ts":"1696125710827"} 2023-10-01 02:01:50,829 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure b610ccdb2ef1a9821ea892c02456fcfb, server=jenkins-hbase17.apache.org,43503,1696125669195}] 2023-10-01 02:01:50,830 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 8180712ba8f72a70819a5429df6c50c0, server=jenkins-hbase17.apache.org,45065,1696125669145}] 2023-10-01 02:01:50,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-01 02:01:50,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb. 2023-10-01 02:01:50,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0. 2023-10-01 02:01:50,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b610ccdb2ef1a9821ea892c02456fcfb, NAME => 'testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 02:01:50,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8180712ba8f72a70819a5429df6c50c0, NAME => 'testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 02:01:50,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0. service=AccessControlService 2023-10-01 02:01:50,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb. service=AccessControlService 2023-10-01 02:01:50,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 02:01:50,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 02:01:50,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 8180712ba8f72a70819a5429df6c50c0 2023-10-01 02:01:50,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports b610ccdb2ef1a9821ea892c02456fcfb 2023-10-01 02:01:50,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:01:50,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:01:50,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 8180712ba8f72a70819a5429df6c50c0 2023-10-01 02:01:50,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for b610ccdb2ef1a9821ea892c02456fcfb 2023-10-01 02:01:50,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 8180712ba8f72a70819a5429df6c50c0 2023-10-01 02:01:50,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for b610ccdb2ef1a9821ea892c02456fcfb 2023-10-01 02:01:50,986 INFO [StoreOpener-b610ccdb2ef1a9821ea892c02456fcfb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b610ccdb2ef1a9821ea892c02456fcfb 2023-10-01 02:01:50,986 INFO [StoreOpener-8180712ba8f72a70819a5429df6c50c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8180712ba8f72a70819a5429df6c50c0 2023-10-01 02:01:50,987 DEBUG [StoreOpener-b610ccdb2ef1a9821ea892c02456fcfb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testConsecutiveExports/b610ccdb2ef1a9821ea892c02456fcfb/cf 2023-10-01 02:01:50,987 DEBUG [StoreOpener-b610ccdb2ef1a9821ea892c02456fcfb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testConsecutiveExports/b610ccdb2ef1a9821ea892c02456fcfb/cf 2023-10-01 02:01:50,988 DEBUG [StoreOpener-8180712ba8f72a70819a5429df6c50c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testConsecutiveExports/8180712ba8f72a70819a5429df6c50c0/cf 2023-10-01 02:01:50,988 DEBUG [StoreOpener-8180712ba8f72a70819a5429df6c50c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testConsecutiveExports/8180712ba8f72a70819a5429df6c50c0/cf 2023-10-01 02:01:50,988 INFO [StoreOpener-8180712ba8f72a70819a5429df6c50c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8180712ba8f72a70819a5429df6c50c0 columnFamilyName cf 2023-10-01 02:01:50,988 INFO [StoreOpener-b610ccdb2ef1a9821ea892c02456fcfb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b610ccdb2ef1a9821ea892c02456fcfb columnFamilyName cf 2023-10-01 02:01:50,989 INFO [StoreOpener-8180712ba8f72a70819a5429df6c50c0-1] regionserver.HStore(310): Store=8180712ba8f72a70819a5429df6c50c0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 02:01:50,989 INFO [StoreOpener-b610ccdb2ef1a9821ea892c02456fcfb-1] regionserver.HStore(310): Store=b610ccdb2ef1a9821ea892c02456fcfb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 02:01:50,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testConsecutiveExports/8180712ba8f72a70819a5429df6c50c0 2023-10-01 02:01:50,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testConsecutiveExports/b610ccdb2ef1a9821ea892c02456fcfb 2023-10-01 02:01:50,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testConsecutiveExports/8180712ba8f72a70819a5429df6c50c0 2023-10-01 02:01:50,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testConsecutiveExports/b610ccdb2ef1a9821ea892c02456fcfb 2023-10-01 02:01:50,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for b610ccdb2ef1a9821ea892c02456fcfb 2023-10-01 02:01:50,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 8180712ba8f72a70819a5429df6c50c0 2023-10-01 02:01:50,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testConsecutiveExports/8180712ba8f72a70819a5429df6c50c0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 02:01:50,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testConsecutiveExports/b610ccdb2ef1a9821ea892c02456fcfb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 02:01:50,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened b610ccdb2ef1a9821ea892c02456fcfb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64057818, jitterRate=-0.045464128255844116}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 02:01:50,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 8180712ba8f72a70819a5429df6c50c0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69644845, jitterRate=0.03778906166553497}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 02:01:50,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for b610ccdb2ef1a9821ea892c02456fcfb: 2023-10-01 02:01:50,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 8180712ba8f72a70819a5429df6c50c0: 2023-10-01 02:01:50,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0., pid=46, masterSystemTime=1696125710981 2023-10-01 02:01:50,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb., pid=45, masterSystemTime=1696125710981 2023-10-01 02:01:50,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0. 2023-10-01 02:01:50,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0. 2023-10-01 02:01:50,999 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=8180712ba8f72a70819a5429df6c50c0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:50,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb. 2023-10-01 02:01:50,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb. 2023-10-01 02:01:50,999 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696125710999"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696125710999"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696125710999"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696125710999"}]},"ts":"1696125710999"} 2023-10-01 02:01:50,999 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=b610ccdb2ef1a9821ea892c02456fcfb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:50,999 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696125710999"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696125710999"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696125710999"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696125710999"}]},"ts":"1696125710999"} 2023-10-01 02:01:51,002 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-10-01 02:01:51,002 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 8180712ba8f72a70819a5429df6c50c0, server=jenkins-hbase17.apache.org,45065,1696125669145 in 170 msec 2023-10-01 02:01:51,003 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-10-01 02:01:51,003 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure b610ccdb2ef1a9821ea892c02456fcfb, server=jenkins-hbase17.apache.org,43503,1696125669195 in 172 msec 2023-10-01 02:01:51,003 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8180712ba8f72a70819a5429df6c50c0, ASSIGN in 336 msec 2023-10-01 02:01:51,004 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-10-01 02:01:51,004 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b610ccdb2ef1a9821ea892c02456fcfb, ASSIGN in 337 msec 2023-10-01 02:01:51,005 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 02:01:51,005 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125711005"}]},"ts":"1696125711005"} 2023-10-01 02:01:51,006 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-10-01 02:01:51,008 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 02:01:51,008 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-10-01 02:01:51,010 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45065] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-01 02:01:51,011 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:01:51,011 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:01:51,011 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:01:51,011 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:01:51,012 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-01 02:01:51,012 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-01 02:01:51,012 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-01 02:01:51,012 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-01 02:01:51,013 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 441 msec 2023-10-01 02:01:51,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-01 02:01:51,180 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-10-01 02:01:51,182 DEBUG [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-01 02:01:51,183 DEBUG [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb. 2023-10-01 02:01:51,184 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 02:01:51,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 02:01:51,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696125711200 (current time:1696125711200). 2023-10-01 02:01:51,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 02:01:51,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(139): Connect 0x4aa96d94 to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:01:51,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6bdecfc5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:01:51,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:01:51,212 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:52442, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:01:51,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4aa96d94 to 127.0.0.1:51733 2023-10-01 02:01:51,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:01:51,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(139): Connect 0x5893bd22 to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:01:51,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59d7be69, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:01:51,224 DEBUG [hconnection-0x446ae271-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:01:51,228 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:52452, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:01:51,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:01:51,236 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:51458, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:01:51,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5893bd22 to 127.0.0.1:51733 2023-10-01 02:01:51,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:01:51,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-01 02:01:51,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 02:01:51,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 02:01:51,241 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot, current working dir path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 02:01:51,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 02:01:51,243 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 02:01:51,244 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696126311244 2023-10-01 02:01:51,244 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-01 02:01:51,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 02:01:51,246 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 02:01:51,246 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 02:01:51,249 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 02:01:51,249 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 02:01:51,251 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-10-01 02:01:51,252 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 02:01:51,253 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696126311253 2023-10-01 02:01:51,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,266 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-10-01 02:01:51,266 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:01:51,267 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-10-01 02:01:51,267 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-01 02:01:51,267 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,267 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,268 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:51,268 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:51,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:51,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:51,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:51,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:51,268 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,268 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:51,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:51,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:51,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,269 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,269 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,269 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,269 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,269 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-01 02:01:51,269 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,270 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 02:01:51,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-01 02:01:51,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-01 02:01:51,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,270 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 02:01:51,270 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 02:01:51,270 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 02:01:51,270 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,270 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,270 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 02:01:51,270 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 02:01:51,270 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:01:51,270 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:01:51,273 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,274 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 02:01:51,274 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 02:01:51,274 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:01:51,274 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 02:01:51,277 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-01 02:01:51,277 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 02:01:51,277 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-01 02:01:51,277 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,45065,1696125669145' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-01 02:01:51,274 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-01 02:01:51,277 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44975,1696125669240' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-01 02:01:51,277 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,43503,1696125669195' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-01 02:01:51,279 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,279 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:51,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:51,279 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,279 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,279 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,279 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:01:51,279 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:51,279 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,280 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:01:51,280 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,280 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:01:51,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:51,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:51,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:51,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,43503,1696125669195' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-01 02:01:51,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48bc4aa5[Count = 1] remaining members to acquire global barrier 2023-10-01 02:01:51,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:51,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:51,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:51,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:51,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:51,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:51,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,45065,1696125669145' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-01 02:01:51,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48bc4aa5[Count = 0] remaining members to acquire global barrier 2023-10-01 02:01:51,284 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-01 02:01:51,284 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,286 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,286 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,286 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,286 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 02:01:51,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,286 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,286 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 02:01:51,286 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 02:01:51,286 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 02:01:51,286 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0. 2023-10-01 02:01:51,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,286 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-01 02:01:51,286 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 02:01:51,286 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,287 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 02:01:51,287 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 02:01:51,287 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 02:01:51,287 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb. 2023-10-01 02:01:51,286 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0. started... 2023-10-01 02:01:51,287 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb. started... 2023-10-01 02:01:51,287 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,44975,1696125669240' in zk 2023-10-01 02:01:51,288 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8180712ba8f72a70819a5429df6c50c0: 2023-10-01 02:01:51,288 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b610ccdb2ef1a9821ea892c02456fcfb: 2023-10-01 02:01:51,288 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,288 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,290 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 02:01:51,290 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 02:01:51,290 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 02:01:51,290 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 02:01:51,290 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 02:01:51,290 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:01:51,290 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-01 02:01:51,307 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb. completed. 2023-10-01 02:01:51,307 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0. completed. 2023-10-01 02:01:51,307 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb. 2023-10-01 02:01:51,307 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0. 2023-10-01 02:01:51,307 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 02:01:51,307 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 02:01:51,307 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,307 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-01 02:01:51,307 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,43503,1696125669195' in zk 2023-10-01 02:01:51,307 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 02:01:51,307 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 02:01:51,307 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,307 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-01 02:01:51,307 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,45065,1696125669145' in zk 2023-10-01 02:01:51,308 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 02:01:51,308 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,308 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:01:51,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,308 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-01 02:01:51,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:51,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:51,310 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 02:01:51,310 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:01:51,310 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-01 02:01:51,312 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:51,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:51,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:51,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:51,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:51,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,43503,1696125669195': 2023-10-01 02:01:51,317 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,43503,1696125669195' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-01 02:01:51,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:51,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:51,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:51,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:51,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:51,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:51,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:51,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,45065,1696125669145': 2023-10-01 02:01:51,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,45065,1696125669145' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-01 02:01:51,319 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-10-01 02:01:51,320 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 02:01:51,320 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 02:01:51,320 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,320 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 02:01:51,321 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,321 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,321 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,321 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:51,321 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:51,321 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:51,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:51,321 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:51,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:51,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:51,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:51,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:51,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:51,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:51,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:51,322 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,323 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:51,323 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:51,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:51,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:51,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,324 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,325 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,325 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:51,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:51,327 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:51,327 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:51,328 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:51,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:51,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:51,328 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:51,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:51,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:51,328 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:01:51,328 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,328 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-01 02:01:51,329 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:51,329 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:51,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:51,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:51,330 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,329 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,330 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 02:01:51,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:51,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:51,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:51,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:51,329 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:51,330 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:51,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:51,330 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,330 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,330 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:51,330 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,330 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,331 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,331 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,331 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 02:01:51,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,339 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,346 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 02:01:51,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-01 02:01:51,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-01 02:01:51,348 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 02:01:51,374 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,375 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-01 02:01:51,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,376 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-01 02:01:51,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696125711244Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696125711338 (+94 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1696125711338Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1696125711338Writing data manifest for emptySnaptb0-testConsecutiveExports at 1696125711347 (+9 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1696125711366 (+19 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696125711375 (+9 ms) 2023-10-01 02:01:51,378 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 02:01:51,380 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 134 msec 2023-10-01 02:01:51,548 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 02:01:51,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-01 02:01:51,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 02:01:51,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43503] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 02:01:51,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45065] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 02:01:51,556 DEBUG [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-01 02:01:51,556 DEBUG [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb. 2023-10-01 02:01:51,556 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 02:01:51,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 02:01:51,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696125711568 (current time:1696125711568). 2023-10-01 02:01:51,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 02:01:51,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(139): Connect 0x6af4265e to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:01:51,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@249a0141, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:01:51,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:01:51,583 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:52466, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:01:51,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6af4265e to 127.0.0.1:51733 2023-10-01 02:01:51,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:01:51,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(139): Connect 0x21350f76 to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:01:51,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a380bd8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:01:51,597 DEBUG [hconnection-0x1e5c9fd7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:01:51,601 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:52480, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:01:51,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:01:51,609 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:51464, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:01:51,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21350f76 to 127.0.0.1:51733 2023-10-01 02:01:51,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:01:51,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-01 02:01:51,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 02:01:51,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 02:01:51,615 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot, current working dir path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 02:01:51,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 02:01:51,618 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 02:01:51,619 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696126311619 2023-10-01 02:01:51,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 02:01:51,619 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-01 02:01:51,621 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 02:01:51,621 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 02:01:51,621 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 02:01:51,623 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 02:01:51,624 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-10-01 02:01:51,626 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 02:01:51,626 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696126311626 2023-10-01 02:01:51,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-10-01 02:01:51,644 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-10-01 02:01:51,644 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:01:51,645 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-10-01 02:01:51,645 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-01 02:01:51,646 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,646 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,647 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,647 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:51,647 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:51,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:51,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:51,647 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:51,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:51,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:51,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:51,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:51,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,647 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,648 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,648 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,648 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,648 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,648 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,648 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 02:01:51,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-01 02:01:51,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-01 02:01:51,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-01 02:01:51,648 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 02:01:51,648 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 02:01:51,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,648 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-01 02:01:51,648 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 02:01:51,649 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-01 02:01:51,649 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 02:01:51,649 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 02:01:51,649 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:01:51,649 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:01:51,650 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 02:01:51,652 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 02:01:51,652 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-01 02:01:51,649 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-01 02:01:51,652 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,45065,1696125669145' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-01 02:01:51,652 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 02:01:51,652 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:01:51,652 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-01 02:01:51,653 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 02:01:51,653 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-01 02:01:51,653 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44975,1696125669240' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-01 02:01:51,653 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,43503,1696125669195' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-01 02:01:51,654 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,654 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:51,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:51,654 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,655 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,655 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,655 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,655 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:01:51,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:51,655 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,655 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,655 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:01:51,655 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:01:51,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:51,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 02:01:51,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:51,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:51,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,45065,1696125669145' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-01 02:01:51,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b181daa[Count = 1] remaining members to acquire global barrier 2023-10-01 02:01:51,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:51,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:51,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:51,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:51,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 02:01:51,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:51,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:51,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,43503,1696125669195' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-01 02:01:51,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b181daa[Count = 0] remaining members to acquire global barrier 2023-10-01 02:01:51,658 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-01 02:01:51,658 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,658 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,658 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,658 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,659 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,659 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 02:01:51,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,659 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 02:01:51,659 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,659 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 02:01:51,659 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 02:01:51,659 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-01 02:01:51,659 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,44975,1696125669240' in zk 2023-10-01 02:01:51,659 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 02:01:51,659 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 02:01:51,659 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0. 2023-10-01 02:01:51,659 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 02:01:51,659 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 02:01:51,659 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0. started... 2023-10-01 02:01:51,659 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb. 2023-10-01 02:01:51,659 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb. started... 2023-10-01 02:01:51,660 INFO [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8180712ba8f72a70819a5429df6c50c0 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-01 02:01:51,660 INFO [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b610ccdb2ef1a9821ea892c02456fcfb 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-01 02:01:51,660 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 02:01:51,660 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:01:51,660 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-01 02:01:51,683 INFO [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310012f9d002a41f54476a09e73f25e7a6670 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310012f9d002a41f54476a09e73f25e7a6670 2023-10-01 02:01:51,698 INFO [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testConsecutiveExports/b610ccdb2ef1a9821ea892c02456fcfb/.tmp/cf/606cb8897e914e7e842eced8e75865ad 2023-10-01 02:01:51,701 INFO [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231001f24166784eb84ec79d29885240bb53d3 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231001f24166784eb84ec79d29885240bb53d3 2023-10-01 02:01:51,706 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testConsecutiveExports/b610ccdb2ef1a9821ea892c02456fcfb/.tmp/cf/606cb8897e914e7e842eced8e75865ad as hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testConsecutiveExports/b610ccdb2ef1a9821ea892c02456fcfb/cf/606cb8897e914e7e842eced8e75865ad 2023-10-01 02:01:51,710 INFO [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testConsecutiveExports/8180712ba8f72a70819a5429df6c50c0/.tmp/cf/886c37177d114f61b59d2bb63ca89acc 2023-10-01 02:01:51,712 INFO [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testConsecutiveExports/b610ccdb2ef1a9821ea892c02456fcfb/cf/606cb8897e914e7e842eced8e75865ad, entries=4, sequenceid=6, filesize=5.5 K 2023-10-01 02:01:51,713 INFO [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for b610ccdb2ef1a9821ea892c02456fcfb in 53ms, sequenceid=6, compaction requested=false 2023-10-01 02:01:51,714 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-01 02:01:51,714 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b610ccdb2ef1a9821ea892c02456fcfb: 2023-10-01 02:01:51,715 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-01 02:01:51,715 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 02:01:51,715 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testConsecutiveExports/b610ccdb2ef1a9821ea892c02456fcfb/cf/606cb8897e914e7e842eced8e75865ad] hfiles 2023-10-01 02:01:51,715 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testConsecutiveExports/b610ccdb2ef1a9821ea892c02456fcfb/cf/606cb8897e914e7e842eced8e75865ad for snapshot=snaptb0-testConsecutiveExports 2023-10-01 02:01:51,717 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testConsecutiveExports/8180712ba8f72a70819a5429df6c50c0/.tmp/cf/886c37177d114f61b59d2bb63ca89acc as hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testConsecutiveExports/8180712ba8f72a70819a5429df6c50c0/cf/886c37177d114f61b59d2bb63ca89acc 2023-10-01 02:01:51,721 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 02:01:51,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-01 02:01:51,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-01 02:01:51,723 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 02:01:51,723 INFO [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testConsecutiveExports/8180712ba8f72a70819a5429df6c50c0/cf/886c37177d114f61b59d2bb63ca89acc, entries=46, sequenceid=6, filesize=12.5 K 2023-10-01 02:01:51,725 INFO [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 8180712ba8f72a70819a5429df6c50c0 in 65ms, sequenceid=6, compaction requested=false 2023-10-01 02:01:51,727 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8180712ba8f72a70819a5429df6c50c0: 2023-10-01 02:01:51,727 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-01 02:01:51,727 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 02:01:51,728 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testConsecutiveExports/8180712ba8f72a70819a5429df6c50c0/cf/886c37177d114f61b59d2bb63ca89acc] hfiles 2023-10-01 02:01:51,728 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testConsecutiveExports/8180712ba8f72a70819a5429df6c50c0/cf/886c37177d114f61b59d2bb63ca89acc for snapshot=snaptb0-testConsecutiveExports 2023-10-01 02:01:51,737 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb. completed. 2023-10-01 02:01:51,738 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb. 2023-10-01 02:01:51,738 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 02:01:51,738 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 02:01:51,738 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,738 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-01 02:01:51,738 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,43503,1696125669195' in zk 2023-10-01 02:01:51,739 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,739 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 02:01:51,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,739 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:01:51,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:51,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:51,739 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-01 02:01:51,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:51,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:51,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 02:01:51,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,743 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0. completed. 2023-10-01 02:01:51,743 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0. 2023-10-01 02:01:51,743 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 02:01:51,743 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 02:01:51,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:51,743 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,743 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-01 02:01:51,743 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,45065,1696125669145' in zk 2023-10-01 02:01:51,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:51,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 02:01:51,744 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,744 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 02:01:51,744 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:01:51,744 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-01 02:01:51,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:51,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,43503,1696125669195': 2023-10-01 02:01:51,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,43503,1696125669195' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-01 02:01:51,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:51,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:51,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:51,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:51,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 02:01:51,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:51,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:51,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 02:01:51,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:51,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,45065,1696125669145': 2023-10-01 02:01:51,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,45065,1696125669145' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-01 02:01:51,750 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-10-01 02:01:51,750 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 02:01:51,750 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 02:01:51,750 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-10-01 02:01:51,750 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 02:01:51,751 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,751 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,751 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:01:51,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:01:51,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,751 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:51,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,751 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:51,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,751 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,752 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:51,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:51,752 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:51,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:51,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:01:51,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:51,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:51,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:51,752 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,753 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:51,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 02:01:51,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:01:51,757 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 02:01:51,758 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,758 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:51,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:51,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:01:51,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 02:01:51,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:51,762 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:51,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:51,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:51,762 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:51,762 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:51,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:51,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:51,762 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:51,762 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:01:51,762 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:01:51,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:01:51,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:01:51,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:51,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:51,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:51,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:51,762 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-10-01 02:01:51,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports because node does not exist (not an error) 2023-10-01 02:01:51,762 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:01:51,763 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-01 02:01:51,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:01:51,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:01:51,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-01 02:01:51,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 02:01:51,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231001f24166784eb84ec79d29885240bb53d3, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310012f9d002a41f54476a09e73f25e7a6670] mob files 2023-10-01 02:01:51,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231001f24166784eb84ec79d29885240bb53d3 2023-10-01 02:01:51,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310012f9d002a41f54476a09e73f25e7a6670 2023-10-01 02:01:51,766 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:51,766 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,766 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,766 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,766 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,766 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:01:51,766 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,766 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:01:51,767 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:01:51,767 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,767 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,775 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-10-01 02:01:51,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,795 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-01 02:01:51,795 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,796 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696125711619Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696125711775 (+156 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1696125711775Loading Region manifests for snaptb0-testConsecutiveExports at 1696125711775Writing data manifest for snaptb0-testConsecutiveExports at 1696125711779 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1696125711786 (+7 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696125711795 (+9 ms) 2023-10-01 02:01:51,799 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 02:01:51,800 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 178 msec 2023-10-01 02:01:51,923 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 02:01:51,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-01 02:01:51,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 02:01:51,925 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/local-export-1696125711925 2023-10-01 02:01:51,925 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/local-export-1696125711925, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/local-export-1696125711925, srcFsUri=hdfs://localhost:33385, srcDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae 2023-10-01 02:01:51,944 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33385, inputRoot=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae 2023-10-01 02:01:51,944 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@12822df6, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/local-export-1696125711925, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/local-export-1696125711925/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,944 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33385, inputRoot=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae, snapshotDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-01 02:01:51,954 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/local-export-1696125711925/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 02:01:51,966 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:51,967 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:51,967 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:51,968 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:52,726 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/hadoop-2183583652887991838.jar 2023-10-01 02:01:52,727 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:52,727 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:52,781 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/hadoop-1452991429182455395.jar 2023-10-01 02:01:52,782 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:52,782 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:52,783 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:52,783 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:52,783 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:52,784 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 02:01:52,784 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 02:01:52,784 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 02:01:52,785 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 02:01:52,785 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 02:01:52,785 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 02:01:52,786 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 02:01:52,786 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 02:01:52,786 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 02:01:52,787 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 02:01:52,787 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 02:01:52,788 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:01:52,788 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:01:52,788 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 02:01:52,789 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:01:52,789 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:01:52,789 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 02:01:52,790 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 02:01:53,165 WARN [Listener at jenkins-hbase17.apache.org/41447] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 02:01:53,167 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-01 02:01:53,169 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-01 02:01:54,509 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 02:01:54,509 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 02:01:54,515 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0002_000001 (auth:SIMPLE) 2023-10-01 02:01:55,423 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0003_000001 (auth:SIMPLE) 2023-10-01 02:01:55,840 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 02:01:58,766 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0003_000001 (auth:SIMPLE) 2023-10-01 02:02:00,968 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0003_000001 (auth:SIMPLE) 2023-10-01 02:02:02,940 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0003_000001 (auth:SIMPLE) 2023-10-01 02:02:04,331 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 02:02:04,331 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 02:02:04,335 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-01 02:02:04,335 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 02:02:04,335 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 02:02:04,336 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-403693088_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-01 02:02:04,338 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-01 02:02:04,338 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-01 02:02:04,338 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@40f5250a in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/local-export-1696125711925/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/local-export-1696125711925/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-01 02:02:04,339 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/local-export-1696125711925/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-01 02:02:04,339 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/local-export-1696125711925/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-01 02:02:04,340 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/local-export-1696125711925, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/local-export-1696125711925, srcFsUri=hdfs://localhost:33385, srcDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae 2023-10-01 02:02:04,357 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33385, inputRoot=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae 2023-10-01 02:02:04,357 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@1b37914a, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/local-export-1696125711925, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/local-export-1696125711925/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 02:02:04,357 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33385, inputRoot=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae, snapshotDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-01 02:02:04,368 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/local-export-1696125711925/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 02:02:04,379 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:04,379 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:04,379 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:04,380 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:05,092 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/hadoop-3888915286345111538.jar 2023-10-01 02:02:05,092 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:05,093 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:05,147 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/hadoop-3511326855425115672.jar 2023-10-01 02:02:05,148 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:05,148 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:05,148 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:05,149 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:05,149 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:05,149 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:05,150 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 02:02:05,150 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 02:02:05,150 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 02:02:05,151 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 02:02:05,151 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 02:02:05,151 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 02:02:05,152 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 02:02:05,152 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 02:02:05,152 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 02:02:05,153 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 02:02:05,153 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:02:05,154 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:02:05,154 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 02:02:05,154 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:02:05,155 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:02:05,155 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 02:02:05,155 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 02:02:05,497 WARN [Listener at jenkins-hbase17.apache.org/41447] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 02:02:05,499 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-01 02:02:05,501 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-01 02:02:09,110 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 02:02:09,110 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 02:02:09,114 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0003_000001 (auth:SIMPLE) 2023-10-01 02:02:09,524 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0004_000001 (auth:SIMPLE) 2023-10-01 02:02:12,807 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0004_000001 (auth:SIMPLE) 2023-10-01 02:02:15,003 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0004_000001 (auth:SIMPLE) 2023-10-01 02:02:17,574 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0004_000001 (auth:SIMPLE) 2023-10-01 02:02:18,661 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 02:02:18,662 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 02:02:18,664 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-01 02:02:18,665 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 02:02:18,665 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 02:02:18,665 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-403693088_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-01 02:02:18,668 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-01 02:02:18,669 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-01 02:02:18,669 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@40f5250a in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/local-export-1696125711925/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/local-export-1696125711925/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-01 02:02:18,669 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/local-export-1696125711925/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-01 02:02:18,669 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/local-export-1696125711925/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-01 02:02:18,679 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-10-01 02:02:18,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testConsecutiveExports 2023-10-01 02:02:18,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-10-01 02:02:18,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-01 02:02:18,684 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125738684"}]},"ts":"1696125738684"} 2023-10-01 02:02:18,686 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-10-01 02:02:18,687 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-10-01 02:02:18,688 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b610ccdb2ef1a9821ea892c02456fcfb, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8180712ba8f72a70819a5429df6c50c0, UNASSIGN}] 2023-10-01 02:02:18,690 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b610ccdb2ef1a9821ea892c02456fcfb, UNASSIGN 2023-10-01 02:02:18,690 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8180712ba8f72a70819a5429df6c50c0, UNASSIGN 2023-10-01 02:02:18,691 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=b610ccdb2ef1a9821ea892c02456fcfb, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:18,691 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=8180712ba8f72a70819a5429df6c50c0, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:18,692 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696125738691"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125738691"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125738691"}]},"ts":"1696125738691"} 2023-10-01 02:02:18,692 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696125738691"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125738691"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125738691"}]},"ts":"1696125738691"} 2023-10-01 02:02:18,693 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure b610ccdb2ef1a9821ea892c02456fcfb, server=jenkins-hbase17.apache.org,43503,1696125669195}] 2023-10-01 02:02:18,696 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 8180712ba8f72a70819a5429df6c50c0, server=jenkins-hbase17.apache.org,45065,1696125669145}] 2023-10-01 02:02:18,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-01 02:02:18,847 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close b610ccdb2ef1a9821ea892c02456fcfb 2023-10-01 02:02:18,847 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 8180712ba8f72a70819a5429df6c50c0 2023-10-01 02:02:18,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing b610ccdb2ef1a9821ea892c02456fcfb, disabling compactions & flushes 2023-10-01 02:02:18,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 8180712ba8f72a70819a5429df6c50c0, disabling compactions & flushes 2023-10-01 02:02:18,847 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb. 2023-10-01 02:02:18,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb. 2023-10-01 02:02:18,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb. after waiting 0 ms 2023-10-01 02:02:18,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb. 2023-10-01 02:02:18,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0. 2023-10-01 02:02:18,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0. 2023-10-01 02:02:18,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0. after waiting 0 ms 2023-10-01 02:02:18,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0. 2023-10-01 02:02:18,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testConsecutiveExports/b610ccdb2ef1a9821ea892c02456fcfb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 02:02:18,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testConsecutiveExports/8180712ba8f72a70819a5429df6c50c0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 02:02:18,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 02:02:18,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 02:02:18,863 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0. 2023-10-01 02:02:18,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 8180712ba8f72a70819a5429df6c50c0: 2023-10-01 02:02:18,863 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb. 2023-10-01 02:02:18,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for b610ccdb2ef1a9821ea892c02456fcfb: 2023-10-01 02:02:18,865 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed b610ccdb2ef1a9821ea892c02456fcfb 2023-10-01 02:02:18,865 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=b610ccdb2ef1a9821ea892c02456fcfb, regionState=CLOSED 2023-10-01 02:02:18,865 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 8180712ba8f72a70819a5429df6c50c0 2023-10-01 02:02:18,865 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696125738865"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125738865"}]},"ts":"1696125738865"} 2023-10-01 02:02:18,866 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=8180712ba8f72a70819a5429df6c50c0, regionState=CLOSED 2023-10-01 02:02:18,866 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696125738866"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125738866"}]},"ts":"1696125738866"} 2023-10-01 02:02:18,869 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-10-01 02:02:18,869 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure b610ccdb2ef1a9821ea892c02456fcfb, server=jenkins-hbase17.apache.org,43503,1696125669195 in 174 msec 2023-10-01 02:02:18,869 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-10-01 02:02:18,869 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 8180712ba8f72a70819a5429df6c50c0, server=jenkins-hbase17.apache.org,45065,1696125669145 in 171 msec 2023-10-01 02:02:18,870 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b610ccdb2ef1a9821ea892c02456fcfb, UNASSIGN in 181 msec 2023-10-01 02:02:18,870 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-10-01 02:02:18,871 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8180712ba8f72a70819a5429df6c50c0, UNASSIGN in 181 msec 2023-10-01 02:02:18,871 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125738871"}]},"ts":"1696125738871"} 2023-10-01 02:02:18,872 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-10-01 02:02:18,873 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-10-01 02:02:18,875 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 194 msec 2023-10-01 02:02:18,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-01 02:02:18,986 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-10-01 02:02:18,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testConsecutiveExports 2023-10-01 02:02:18,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 02:02:18,989 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 02:02:18,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-10-01 02:02:18,990 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 02:02:18,993 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45065] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-10-01 02:02:18,995 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 02:02:18,995 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 02:02:18,995 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 02:02:18,995 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 02:02:18,995 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-01 02:02:18,995 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-01 02:02:18,995 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-01 02:02:18,995 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-01 02:02:18,996 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 02:02:18,996 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 02:02:18,996 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 02:02:18,996 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:18,996 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 02:02:18,996 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:18,996 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:18,996 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:18,996 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testConsecutiveExports/b610ccdb2ef1a9821ea892c02456fcfb 2023-10-01 02:02:18,997 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testConsecutiveExports/8180712ba8f72a70819a5429df6c50c0 2023-10-01 02:02:18,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-01 02:02:18,998 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testConsecutiveExports/b610ccdb2ef1a9821ea892c02456fcfb/cf, FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testConsecutiveExports/b610ccdb2ef1a9821ea892c02456fcfb/recovered.edits] 2023-10-01 02:02:18,998 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testConsecutiveExports/8180712ba8f72a70819a5429df6c50c0/cf, FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testConsecutiveExports/8180712ba8f72a70819a5429df6c50c0/recovered.edits] 2023-10-01 02:02:19,003 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testConsecutiveExports/b610ccdb2ef1a9821ea892c02456fcfb/cf/606cb8897e914e7e842eced8e75865ad to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testConsecutiveExports/b610ccdb2ef1a9821ea892c02456fcfb/cf/606cb8897e914e7e842eced8e75865ad 2023-10-01 02:02:19,003 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testConsecutiveExports/8180712ba8f72a70819a5429df6c50c0/cf/886c37177d114f61b59d2bb63ca89acc to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testConsecutiveExports/8180712ba8f72a70819a5429df6c50c0/cf/886c37177d114f61b59d2bb63ca89acc 2023-10-01 02:02:19,006 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testConsecutiveExports/b610ccdb2ef1a9821ea892c02456fcfb/recovered.edits/9.seqid to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testConsecutiveExports/b610ccdb2ef1a9821ea892c02456fcfb/recovered.edits/9.seqid 2023-10-01 02:02:19,006 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testConsecutiveExports/8180712ba8f72a70819a5429df6c50c0/recovered.edits/9.seqid to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testConsecutiveExports/8180712ba8f72a70819a5429df6c50c0/recovered.edits/9.seqid 2023-10-01 02:02:19,006 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testConsecutiveExports/b610ccdb2ef1a9821ea892c02456fcfb 2023-10-01 02:02:19,006 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testConsecutiveExports/8180712ba8f72a70819a5429df6c50c0 2023-10-01 02:02:19,006 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-01 02:02:19,007 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-01 02:02:19,007 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-10-01 02:02:19,010 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231001f24166784eb84ec79d29885240bb53d3 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231001f24166784eb84ec79d29885240bb53d3 2023-10-01 02:02:19,012 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310012f9d002a41f54476a09e73f25e7a6670 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310012f9d002a41f54476a09e73f25e7a6670 2023-10-01 02:02:19,012 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-01 02:02:19,014 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 02:02:19,016 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-10-01 02:02:19,018 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-10-01 02:02:19,019 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 02:02:19,020 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-10-01 02:02:19,020 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696125739020"}]},"ts":"9223372036854775807"} 2023-10-01 02:02:19,020 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696125739020"}]},"ts":"9223372036854775807"} 2023-10-01 02:02:19,022 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 02:02:19,022 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b610ccdb2ef1a9821ea892c02456fcfb, NAME => 'testtb-testConsecutiveExports,,1696125710570.b610ccdb2ef1a9821ea892c02456fcfb.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8180712ba8f72a70819a5429df6c50c0, NAME => 'testtb-testConsecutiveExports,1,1696125710570.8180712ba8f72a70819a5429df6c50c0.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 02:02:19,022 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-10-01 02:02:19,022 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696125739022"}]},"ts":"9223372036854775807"} 2023-10-01 02:02:19,024 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-10-01 02:02:19,025 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 02:02:19,027 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 38 msec 2023-10-01 02:02:19,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-01 02:02:19,098 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-10-01 02:02:19,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testConsecutiveExports" 2023-10-01 02:02:19,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-10-01 02:02:19,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testConsecutiveExports" 2023-10-01 02:02:19,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testConsecutiveExports 2023-10-01 02:02:19,135 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=754 (was 769), OpenFileDescriptor=921 (was 937), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=266 (was 353), ProcessCount=179 (was 180), AvailableMemoryMB=8628 (was 8836) 2023-10-01 02:02:19,135 WARN [Listener at jenkins-hbase17.apache.org/41447] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-10-01 02:02:19,152 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=754, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=266, ProcessCount=179, AvailableMemoryMB=8628 2023-10-01 02:02:19,152 WARN [Listener at jenkins-hbase17.apache.org/41447] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-10-01 02:02:19,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 02:02:19,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,158 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 02:02:19,158 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-10-01 02:02:19,159 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 02:02:19,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-01 02:02:19,161 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d776b80c2306b4723aec32a7587e914 2023-10-01 02:02:19,161 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b42ca06b55ea659e9606e11ce42b8aa9 2023-10-01 02:02:19,162 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b42ca06b55ea659e9606e11ce42b8aa9 empty. 2023-10-01 02:02:19,162 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d776b80c2306b4723aec32a7587e914 empty. 2023-10-01 02:02:19,163 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b42ca06b55ea659e9606e11ce42b8aa9 2023-10-01 02:02:19,163 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d776b80c2306b4723aec32a7587e914 2023-10-01 02:02:19,163 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-01 02:02:19,172 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-10-01 02:02:19,173 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3d776b80c2306b4723aec32a7587e914, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp 2023-10-01 02:02:19,173 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => b42ca06b55ea659e9606e11ce42b8aa9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp 2023-10-01 02:02:19,199 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:02:19,199 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:02:19,199 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing b42ca06b55ea659e9606e11ce42b8aa9, disabling compactions & flushes 2023-10-01 02:02:19,199 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 3d776b80c2306b4723aec32a7587e914, disabling compactions & flushes 2023-10-01 02:02:19,199 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9. 2023-10-01 02:02:19,199 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914. 2023-10-01 02:02:19,199 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9. 2023-10-01 02:02:19,199 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9. after waiting 0 ms 2023-10-01 02:02:19,199 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914. 2023-10-01 02:02:19,199 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9. 2023-10-01 02:02:19,199 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914. after waiting 0 ms 2023-10-01 02:02:19,199 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9. 2023-10-01 02:02:19,199 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914. 2023-10-01 02:02:19,199 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for b42ca06b55ea659e9606e11ce42b8aa9: 2023-10-01 02:02:19,200 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914. 2023-10-01 02:02:19,200 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 3d776b80c2306b4723aec32a7587e914: 2023-10-01 02:02:19,202 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 02:02:19,203 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696125739203"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125739203"}]},"ts":"1696125739203"} 2023-10-01 02:02:19,203 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696125739203"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125739203"}]},"ts":"1696125739203"} 2023-10-01 02:02:19,209 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 02:02:19,211 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 02:02:19,211 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125739211"}]},"ts":"1696125739211"} 2023-10-01 02:02:19,212 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-10-01 02:02:19,215 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-10-01 02:02:19,216 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 02:02:19,216 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 02:02:19,216 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 02:02:19,216 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 02:02:19,216 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3d776b80c2306b4723aec32a7587e914, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b42ca06b55ea659e9606e11ce42b8aa9, ASSIGN}] 2023-10-01 02:02:19,219 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3d776b80c2306b4723aec32a7587e914, ASSIGN 2023-10-01 02:02:19,219 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b42ca06b55ea659e9606e11ce42b8aa9, ASSIGN 2023-10-01 02:02:19,220 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3d776b80c2306b4723aec32a7587e914, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,45065,1696125669145; forceNewPlan=false, retain=false 2023-10-01 02:02:19,220 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b42ca06b55ea659e9606e11ce42b8aa9, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,44975,1696125669240; forceNewPlan=false, retain=false 2023-10-01 02:02:19,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-01 02:02:19,370 INFO [jenkins-hbase17:37789] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 02:02:19,373 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=3d776b80c2306b4723aec32a7587e914, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:19,373 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=b42ca06b55ea659e9606e11ce42b8aa9, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:19,373 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696125739373"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125739373"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125739373"}]},"ts":"1696125739373"} 2023-10-01 02:02:19,373 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696125739373"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125739373"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125739373"}]},"ts":"1696125739373"} 2023-10-01 02:02:19,375 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 3d776b80c2306b4723aec32a7587e914, server=jenkins-hbase17.apache.org,45065,1696125669145}] 2023-10-01 02:02:19,376 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure b42ca06b55ea659e9606e11ce42b8aa9, server=jenkins-hbase17.apache.org,44975,1696125669240}] 2023-10-01 02:02:19,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-01 02:02:19,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914. 2023-10-01 02:02:19,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3d776b80c2306b4723aec32a7587e914, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 02:02:19,536 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9. 2023-10-01 02:02:19,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b42ca06b55ea659e9606e11ce42b8aa9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 02:02:19,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914. service=AccessControlService 2023-10-01 02:02:19,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9. service=AccessControlService 2023-10-01 02:02:19,536 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 02:02:19,536 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 02:02:19,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion b42ca06b55ea659e9606e11ce42b8aa9 2023-10-01 02:02:19,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 3d776b80c2306b4723aec32a7587e914 2023-10-01 02:02:19,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:02:19,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:02:19,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for b42ca06b55ea659e9606e11ce42b8aa9 2023-10-01 02:02:19,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for b42ca06b55ea659e9606e11ce42b8aa9 2023-10-01 02:02:19,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 3d776b80c2306b4723aec32a7587e914 2023-10-01 02:02:19,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 3d776b80c2306b4723aec32a7587e914 2023-10-01 02:02:19,539 INFO [StoreOpener-b42ca06b55ea659e9606e11ce42b8aa9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b42ca06b55ea659e9606e11ce42b8aa9 2023-10-01 02:02:19,539 INFO [StoreOpener-3d776b80c2306b4723aec32a7587e914-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3d776b80c2306b4723aec32a7587e914 2023-10-01 02:02:19,543 DEBUG [StoreOpener-3d776b80c2306b4723aec32a7587e914-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d776b80c2306b4723aec32a7587e914/cf 2023-10-01 02:02:19,544 DEBUG [StoreOpener-b42ca06b55ea659e9606e11ce42b8aa9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/b42ca06b55ea659e9606e11ce42b8aa9/cf 2023-10-01 02:02:19,544 DEBUG [StoreOpener-3d776b80c2306b4723aec32a7587e914-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d776b80c2306b4723aec32a7587e914/cf 2023-10-01 02:02:19,544 DEBUG [StoreOpener-b42ca06b55ea659e9606e11ce42b8aa9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/b42ca06b55ea659e9606e11ce42b8aa9/cf 2023-10-01 02:02:19,545 INFO [StoreOpener-3d776b80c2306b4723aec32a7587e914-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3d776b80c2306b4723aec32a7587e914 columnFamilyName cf 2023-10-01 02:02:19,545 INFO [StoreOpener-b42ca06b55ea659e9606e11ce42b8aa9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b42ca06b55ea659e9606e11ce42b8aa9 columnFamilyName cf 2023-10-01 02:02:19,546 INFO [StoreOpener-3d776b80c2306b4723aec32a7587e914-1] regionserver.HStore(310): Store=3d776b80c2306b4723aec32a7587e914/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 02:02:19,546 INFO [StoreOpener-b42ca06b55ea659e9606e11ce42b8aa9-1] regionserver.HStore(310): Store=b42ca06b55ea659e9606e11ce42b8aa9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 02:02:19,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d776b80c2306b4723aec32a7587e914 2023-10-01 02:02:19,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/b42ca06b55ea659e9606e11ce42b8aa9 2023-10-01 02:02:19,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d776b80c2306b4723aec32a7587e914 2023-10-01 02:02:19,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/b42ca06b55ea659e9606e11ce42b8aa9 2023-10-01 02:02:19,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 3d776b80c2306b4723aec32a7587e914 2023-10-01 02:02:19,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for b42ca06b55ea659e9606e11ce42b8aa9 2023-10-01 02:02:19,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d776b80c2306b4723aec32a7587e914/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 02:02:19,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/b42ca06b55ea659e9606e11ce42b8aa9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 02:02:19,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 3d776b80c2306b4723aec32a7587e914; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72941597, jitterRate=0.08691449463367462}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 02:02:19,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 3d776b80c2306b4723aec32a7587e914: 2023-10-01 02:02:19,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened b42ca06b55ea659e9606e11ce42b8aa9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75039061, jitterRate=0.1181691437959671}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 02:02:19,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for b42ca06b55ea659e9606e11ce42b8aa9: 2023-10-01 02:02:19,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9., pid=61, masterSystemTime=1696125739527 2023-10-01 02:02:19,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914., pid=60, masterSystemTime=1696125739527 2023-10-01 02:02:19,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914. 2023-10-01 02:02:19,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914. 2023-10-01 02:02:19,559 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=3d776b80c2306b4723aec32a7587e914, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:19,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9. 2023-10-01 02:02:19,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9. 2023-10-01 02:02:19,559 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696125739559"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696125739559"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696125739559"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696125739559"}]},"ts":"1696125739559"} 2023-10-01 02:02:19,559 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=b42ca06b55ea659e9606e11ce42b8aa9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:19,559 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696125739559"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696125739559"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696125739559"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696125739559"}]},"ts":"1696125739559"} 2023-10-01 02:02:19,567 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-10-01 02:02:19,567 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 3d776b80c2306b4723aec32a7587e914, server=jenkins-hbase17.apache.org,45065,1696125669145 in 190 msec 2023-10-01 02:02:19,567 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-10-01 02:02:19,567 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure b42ca06b55ea659e9606e11ce42b8aa9, server=jenkins-hbase17.apache.org,44975,1696125669240 in 190 msec 2023-10-01 02:02:19,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3d776b80c2306b4723aec32a7587e914, ASSIGN in 351 msec 2023-10-01 02:02:19,569 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-10-01 02:02:19,569 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b42ca06b55ea659e9606e11ce42b8aa9, ASSIGN in 351 msec 2023-10-01 02:02:19,569 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 02:02:19,570 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125739570"}]},"ts":"1696125739570"} 2023-10-01 02:02:19,572 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-10-01 02:02:19,574 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 02:02:19,574 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-10-01 02:02:19,576 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45065] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-01 02:02:19,577 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:19,577 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:19,577 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:19,577 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:19,577 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 02:02:19,577 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 02:02:19,578 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 02:02:19,578 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 02:02:19,579 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 423 msec 2023-10-01 02:02:19,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-01 02:02:19,763 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-10-01 02:02:19,765 DEBUG [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,765 DEBUG [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914. 2023-10-01 02:02:19,767 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 02:02:19,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 02:02:19,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696125739780 (current time:1696125739780). 2023-10-01 02:02:19,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 02:02:19,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(139): Connect 0x586b01f3 to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:02:19,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@338603c2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:02:19,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:02:19,792 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:41236, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:02:19,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x586b01f3 to 127.0.0.1:51733 2023-10-01 02:02:19,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:02:19,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(139): Connect 0x754b455a to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:02:19,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@752fb699, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:02:19,801 DEBUG [hconnection-0x76b433ed-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:02:19,802 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:41238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:02:19,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:02:19,808 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:51558, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:02:19,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x754b455a to 127.0.0.1:51733 2023-10-01 02:02:19,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:02:19,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-01 02:02:19,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 02:02:19,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 02:02:19,813 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot, current working dir path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 02:02:19,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 02:02:19,816 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 02:02:19,817 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696126339817 2023-10-01 02:02:19,817 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 02:02:19,819 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 02:02:19,819 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 02:02:19,820 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 02:02:19,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 02:02:19,821 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-10-01 02:02:19,823 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 02:02:19,823 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696126339823 2023-10-01 02:02:19,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,836 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-01 02:02:19,836 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:19,837 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-01 02:02:19,837 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-01 02:02:19,838 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,838 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,839 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:19,839 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:19,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:19,839 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:19,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:19,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:19,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:19,839 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:19,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:19,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:19,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,839 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:19,840 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,840 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,840 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,840 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:19,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-01 02:02:19,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-01 02:02:19,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-01 02:02:19,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,840 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 02:02:19,840 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 02:02:19,840 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:19,840 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 02:02:19,840 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 02:02:19,840 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,840 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,841 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 02:02:19,841 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 02:02:19,841 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:19,841 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:19,841 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,843 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 02:02:19,843 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 02:02:19,843 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:19,842 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 02:02:19,844 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 02:02:19,844 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,43503,1696125669195' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 02:02:19,844 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 02:02:19,844 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 02:02:19,843 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 02:02:19,844 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,45065,1696125669145' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 02:02:19,844 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44975,1696125669240' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 02:02:19,845 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,846 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:19,846 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,846 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,846 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,846 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:02:19,846 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:19,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:19,846 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,846 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,846 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:02:19,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:19,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:19,846 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:02:19,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:19,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:19,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:19,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:19,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:19,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:19,848 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,45065,1696125669145' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-01 02:02:19,848 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79658b6f[Count = 1] remaining members to acquire global barrier 2023-10-01 02:02:19,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:19,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:19,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:19,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:19,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:19,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:19,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:19,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:19,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:19,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44975,1696125669240' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-01 02:02:19,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79658b6f[Count = 0] remaining members to acquire global barrier 2023-10-01 02:02:19,850 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-01 02:02:19,850 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,851 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,851 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,851 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,851 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 02:02:19,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,851 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:19,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,851 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 02:02:19,851 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 02:02:19,851 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 02:02:19,852 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 02:02:19,852 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:19,852 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 02:02:19,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,852 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914. 2023-10-01 02:02:19,852 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 02:02:19,851 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9. 2023-10-01 02:02:19,852 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914. started... 2023-10-01 02:02:19,852 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 02:02:19,852 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9. started... 2023-10-01 02:02:19,852 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 02:02:19,852 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,43503,1696125669195' in zk 2023-10-01 02:02:19,854 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3d776b80c2306b4723aec32a7587e914: 2023-10-01 02:02:19,854 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b42ca06b55ea659e9606e11ce42b8aa9: 2023-10-01 02:02:19,854 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,854 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,854 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 02:02:19,854 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 02:02:19,854 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 02:02:19,854 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 02:02:19,856 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 02:02:19,856 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:19,856 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 02:02:19,875 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9. completed. 2023-10-01 02:02:19,875 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9. 2023-10-01 02:02:19,875 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 02:02:19,875 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 02:02:19,875 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:19,875 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 02:02:19,875 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,44975,1696125669240' in zk 2023-10-01 02:02:19,876 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914. completed. 2023-10-01 02:02:19,876 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914. 2023-10-01 02:02:19,876 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 02:02:19,876 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 02:02:19,876 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:19,876 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 02:02:19,876 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,45065,1696125669145' in zk 2023-10-01 02:02:19,877 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 02:02:19,877 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:19,877 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:19,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:19,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:19,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:19,877 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 02:02:19,878 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:19,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:19,879 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 02:02:19,879 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:19,879 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 02:02:19,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:19,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:19,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:19,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:19,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:19,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:19,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:19,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:19,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,44975,1696125669240': 2023-10-01 02:02:19,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44975,1696125669240' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-01 02:02:19,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:19,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:19,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:19,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:19,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:19,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:19,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:19,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:19,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:19,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:19,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:19,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:19,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,45065,1696125669145': 2023-10-01 02:02:19,887 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,45065,1696125669145' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-01 02:02:19,887 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-01 02:02:19,887 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 02:02:19,887 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 02:02:19,887 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,887 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 02:02:19,888 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,888 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,888 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:19,888 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,888 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:19,888 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:19,889 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:19,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,889 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:19,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:19,889 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:19,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:19,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:19,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,890 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:19,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:19,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:19,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:19,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:19,891 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:19,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:19,891 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:19,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,892 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:19,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:19,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:19,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:19,895 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:19,895 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,895 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:19,895 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:19,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:19,895 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:19,895 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:19,895 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:19,896 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:19,896 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,896 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:19,896 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,896 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:19,897 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,897 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:19,897 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,897 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:19,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 02:02:19,897 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,897 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:19,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:19,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:19,897 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:19,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:19,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:19,897 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:19,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:19,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:19,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:19,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:19,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 02:02:19,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:19,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:19,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,919 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 02:02:19,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-01 02:02:19,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-01 02:02:19,920 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 02:02:19,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,930 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-01 02:02:19,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,931 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:19,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696125739817Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696125739909 (+92 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696125739909Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696125739909Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696125739914 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696125739924 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696125739930 (+6 ms) 2023-10-01 02:02:19,933 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 02:02:19,935 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 114 msec 2023-10-01 02:02:20,121 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 02:02:20,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-01 02:02:20,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 02:02:20,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45065] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 02:02:20,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44975] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 02:02:20,128 DEBUG [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,128 DEBUG [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914. 2023-10-01 02:02:20,128 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 02:02:20,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 02:02:20,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696125740139 (current time:1696125740139). 2023-10-01 02:02:20,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 02:02:20,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(139): Connect 0x6f01d4df to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:02:20,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5dd84ef7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:02:20,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:02:20,152 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:39582, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:02:20,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f01d4df to 127.0.0.1:51733 2023-10-01 02:02:20,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:02:20,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(139): Connect 0x4f10aaec to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:02:20,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ed638fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:02:20,162 DEBUG [hconnection-0x31667426-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:02:20,165 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:39588, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:02:20,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:02:20,170 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:45770, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:02:20,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f10aaec to 127.0.0.1:51733 2023-10-01 02:02:20,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:02:20,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-01 02:02:20,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 02:02:20,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 02:02:20,175 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot, current working dir path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 02:02:20,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 02:02:20,178 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 02:02:20,178 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696126340178 2023-10-01 02:02:20,178 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 02:02:20,180 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 02:02:20,180 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 02:02:20,181 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 02:02:20,181 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 02:02:20,182 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-10-01 02:02:20,184 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 02:02:20,184 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696126340184 2023-10-01 02:02:20,192 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,192 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-01 02:02:20,192 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:20,194 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-01 02:02:20,194 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-01 02:02:20,194 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,194 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,195 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:20,195 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:20,195 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:20,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:20,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:20,195 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:20,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:20,195 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:20,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:20,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,196 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:20,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,196 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 02:02:20,196 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,196 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,196 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:20,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-01 02:02:20,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:20,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:20,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-01 02:02:20,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,196 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 02:02:20,196 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 02:02:20,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,197 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,197 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 02:02:20,197 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:20,197 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,197 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,197 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 02:02:20,197 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:20,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-01 02:02:20,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,197 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 02:02:20,197 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,198 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 02:02:20,198 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:20,202 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 02:02:20,202 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 02:02:20,202 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 02:02:20,202 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 02:02:20,202 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 02:02:20,202 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,43503,1696125669195' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 02:02:20,202 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 02:02:20,202 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44975,1696125669240' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 02:02:20,203 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,45065,1696125669145' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 02:02:20,204 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:20,204 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,204 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:20,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:20,204 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:20,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:20,204 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,204 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,204 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:02:20,204 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,204 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:02:20,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:20,204 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,204 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:02:20,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:20,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:20,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:20,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:20,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:20,206 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44975,1696125669240' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-01 02:02:20,206 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12488d5d[Count = 1] remaining members to acquire global barrier 2023-10-01 02:02:20,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:20,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:20,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:20,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:20,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:20,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:20,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:20,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:20,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:20,208 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,45065,1696125669145' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-01 02:02:20,208 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12488d5d[Count = 0] remaining members to acquire global barrier 2023-10-01 02:02:20,208 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-01 02:02:20,208 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,208 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,208 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,208 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,209 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 02:02:20,209 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:20,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,209 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 02:02:20,209 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 02:02:20,209 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,43503,1696125669195' in zk 2023-10-01 02:02:20,209 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 02:02:20,209 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:20,209 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 02:02:20,209 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9. 2023-10-01 02:02:20,209 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914. 2023-10-01 02:02:20,209 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 02:02:20,209 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 02:02:20,209 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914. started... 2023-10-01 02:02:20,209 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9. started... 2023-10-01 02:02:20,209 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 02:02:20,209 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 02:02:20,209 INFO [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3d776b80c2306b4723aec32a7587e914 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-01 02:02:20,210 INFO [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b42ca06b55ea659e9606e11ce42b8aa9 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-01 02:02:20,210 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 02:02:20,210 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:20,210 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 02:02:20,227 INFO [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231001e7cca5b51f894a7a83663440b3e8caaf to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231001e7cca5b51f894a7a83663440b3e8caaf 2023-10-01 02:02:20,228 INFO [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310018e80b92ae24f4f65b519ae9037d85f29 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310018e80b92ae24f4f65b519ae9037d85f29 2023-10-01 02:02:20,234 INFO [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d776b80c2306b4723aec32a7587e914/.tmp/cf/e024198ea70647449964cac71667ad73 2023-10-01 02:02:20,235 INFO [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/b42ca06b55ea659e9606e11ce42b8aa9/.tmp/cf/ed6079e5d0054ebb81bc560222272947 2023-10-01 02:02:20,239 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d776b80c2306b4723aec32a7587e914/.tmp/cf/e024198ea70647449964cac71667ad73 as hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d776b80c2306b4723aec32a7587e914/cf/e024198ea70647449964cac71667ad73 2023-10-01 02:02:20,240 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/b42ca06b55ea659e9606e11ce42b8aa9/.tmp/cf/ed6079e5d0054ebb81bc560222272947 as hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/b42ca06b55ea659e9606e11ce42b8aa9/cf/ed6079e5d0054ebb81bc560222272947 2023-10-01 02:02:20,244 INFO [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d776b80c2306b4723aec32a7587e914/cf/e024198ea70647449964cac71667ad73, entries=3, sequenceid=6, filesize=5.4 K 2023-10-01 02:02:20,244 INFO [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/b42ca06b55ea659e9606e11ce42b8aa9/cf/ed6079e5d0054ebb81bc560222272947, entries=47, sequenceid=6, filesize=13.5 K 2023-10-01 02:02:20,245 INFO [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 3d776b80c2306b4723aec32a7587e914 in 36ms, sequenceid=6, compaction requested=false 2023-10-01 02:02:20,245 INFO [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for b42ca06b55ea659e9606e11ce42b8aa9 in 36ms, sequenceid=6, compaction requested=false 2023-10-01 02:02:20,245 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-01 02:02:20,245 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-01 02:02:20,248 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3d776b80c2306b4723aec32a7587e914: 2023-10-01 02:02:20,248 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b42ca06b55ea659e9606e11ce42b8aa9: 2023-10-01 02:02:20,248 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,248 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,248 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 02:02:20,248 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 02:02:20,248 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/b42ca06b55ea659e9606e11ce42b8aa9/cf/ed6079e5d0054ebb81bc560222272947] hfiles 2023-10-01 02:02:20,248 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d776b80c2306b4723aec32a7587e914/cf/e024198ea70647449964cac71667ad73] hfiles 2023-10-01 02:02:20,248 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/b42ca06b55ea659e9606e11ce42b8aa9/cf/ed6079e5d0054ebb81bc560222272947 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,248 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d776b80c2306b4723aec32a7587e914/cf/e024198ea70647449964cac71667ad73 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,261 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914. completed. 2023-10-01 02:02:20,261 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9. completed. 2023-10-01 02:02:20,261 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914. 2023-10-01 02:02:20,261 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9. 2023-10-01 02:02:20,261 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 02:02:20,261 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 02:02:20,261 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 02:02:20,261 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 02:02:20,261 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:20,261 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:20,261 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 02:02:20,261 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 02:02:20,261 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,45065,1696125669145' in zk 2023-10-01 02:02:20,261 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,44975,1696125669240' in zk 2023-10-01 02:02:20,262 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 02:02:20,262 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:20,262 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:20,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:20,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:20,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:20,262 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 02:02:20,264 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:20,264 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 02:02:20,264 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:20,264 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 02:02:20,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:20,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:20,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:20,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:20,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:20,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:20,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:20,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:20,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:20,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,45065,1696125669145': 2023-10-01 02:02:20,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,45065,1696125669145' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-01 02:02:20,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:20,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:20,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:20,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:20,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:20,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:20,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:20,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:20,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:20,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:20,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:20,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:20,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,44975,1696125669240': 2023-10-01 02:02:20,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44975,1696125669240' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-01 02:02:20,270 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-01 02:02:20,270 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 02:02:20,270 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 02:02:20,270 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,270 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 02:02:20,271 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,271 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,271 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,271 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:20,271 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,271 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:20,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:20,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:20,271 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:20,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,271 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:20,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,271 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:20,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:20,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:20,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:20,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:20,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:20,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:20,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:20,272 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:20,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:20,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:20,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:20,273 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:20,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:20,273 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:20,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:20,274 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:20,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:20,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:20,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:20,275 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:20,275 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,275 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:20,275 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:20,275 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:20,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:20,275 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:20,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:20,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:20,275 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:20,275 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:20,275 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:20,276 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:20,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:20,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:20,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:20,276 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,276 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:20,276 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:20,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:20,276 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:20,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 02:02:20,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:20,277 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:20,278 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,278 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:20,278 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:20,278 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,278 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:20,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:20,278 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310018e80b92ae24f4f65b519ae9037d85f29, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231001e7cca5b51f894a7a83663440b3e8caaf] mob files 2023-10-01 02:02:20,278 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310018e80b92ae24f4f65b519ae9037d85f29 2023-10-01 02:02:20,278 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231001e7cca5b51f894a7a83663440b3e8caaf 2023-10-01 02:02:20,281 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 02:02:20,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-01 02:02:20,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-01 02:02:20,282 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 02:02:20,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,322 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-01 02:02:20,322 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,322 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:20,322 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696125740178Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696125740285 (+107 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696125740285Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1696125740285Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1696125740288 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696125740294 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696125740322 (+28 ms) 2023-10-01 02:02:20,326 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 02:02:20,328 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 146 msec 2023-10-01 02:02:20,483 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 02:02:20,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-01 02:02:20,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 02:02:20,506 DEBUG [Listener at jenkins-hbase17.apache.org/41447] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 02:02:20,508 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:39592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 02:02:20,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43503] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-01 02:02:20,510 DEBUG [Listener at jenkins-hbase17.apache.org/41447] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 02:02:20,513 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:36254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 02:02:20,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44975] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-01 02:02:20,514 DEBUG [Listener at jenkins-hbase17.apache.org/41447] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 02:02:20,517 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:45780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 02:02:20,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45065] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-01 02:02:20,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-01 02:02:20,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:20,523 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 02:02:20,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-10-01 02:02:20,524 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 02:02:20,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-01 02:02:20,526 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/898acd85864ff1983ffe252a95853a5c 2023-10-01 02:02:20,526 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/adcb3ce3b962d584401c4bb77a781fb9 2023-10-01 02:02:20,527 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/898acd85864ff1983ffe252a95853a5c empty. 2023-10-01 02:02:20,527 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/adcb3ce3b962d584401c4bb77a781fb9 empty. 2023-10-01 02:02:20,527 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/898acd85864ff1983ffe252a95853a5c 2023-10-01 02:02:20,527 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/adcb3ce3b962d584401c4bb77a781fb9 2023-10-01 02:02:20,527 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-01 02:02:20,538 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-10-01 02:02:20,539 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => adcb3ce3b962d584401c4bb77a781fb9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696125740519.adcb3ce3b962d584401c4bb77a781fb9.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp 2023-10-01 02:02:20,539 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 898acd85864ff1983ffe252a95853a5c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740519.898acd85864ff1983ffe252a95853a5c.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp 2023-10-01 02:02:20,549 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696125740519.adcb3ce3b962d584401c4bb77a781fb9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:02:20,549 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing adcb3ce3b962d584401c4bb77a781fb9, disabling compactions & flushes 2023-10-01 02:02:20,549 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696125740519.adcb3ce3b962d584401c4bb77a781fb9. 2023-10-01 02:02:20,549 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696125740519.adcb3ce3b962d584401c4bb77a781fb9. 2023-10-01 02:02:20,549 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696125740519.adcb3ce3b962d584401c4bb77a781fb9. after waiting 0 ms 2023-10-01 02:02:20,549 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696125740519.adcb3ce3b962d584401c4bb77a781fb9. 2023-10-01 02:02:20,550 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696125740519.adcb3ce3b962d584401c4bb77a781fb9. 2023-10-01 02:02:20,550 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for adcb3ce3b962d584401c4bb77a781fb9: 2023-10-01 02:02:20,555 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740519.898acd85864ff1983ffe252a95853a5c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:02:20,555 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 898acd85864ff1983ffe252a95853a5c, disabling compactions & flushes 2023-10-01 02:02:20,555 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740519.898acd85864ff1983ffe252a95853a5c. 2023-10-01 02:02:20,555 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740519.898acd85864ff1983ffe252a95853a5c. 2023-10-01 02:02:20,555 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740519.898acd85864ff1983ffe252a95853a5c. after waiting 0 ms 2023-10-01 02:02:20,555 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740519.898acd85864ff1983ffe252a95853a5c. 2023-10-01 02:02:20,556 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740519.898acd85864ff1983ffe252a95853a5c. 2023-10-01 02:02:20,556 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 898acd85864ff1983ffe252a95853a5c: 2023-10-01 02:02:20,558 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 02:02:20,558 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696125740519.adcb3ce3b962d584401c4bb77a781fb9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696125740558"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125740558"}]},"ts":"1696125740558"} 2023-10-01 02:02:20,559 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740519.898acd85864ff1983ffe252a95853a5c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696125740558"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125740558"}]},"ts":"1696125740558"} 2023-10-01 02:02:20,560 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 02:02:20,561 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 02:02:20,562 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125740561"}]},"ts":"1696125740561"} 2023-10-01 02:02:20,563 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-10-01 02:02:20,565 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-10-01 02:02:20,566 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 02:02:20,566 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 02:02:20,566 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 02:02:20,566 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 02:02:20,567 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=898acd85864ff1983ffe252a95853a5c, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=adcb3ce3b962d584401c4bb77a781fb9, ASSIGN}] 2023-10-01 02:02:20,569 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=adcb3ce3b962d584401c4bb77a781fb9, ASSIGN 2023-10-01 02:02:20,569 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=898acd85864ff1983ffe252a95853a5c, ASSIGN 2023-10-01 02:02:20,570 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=898acd85864ff1983ffe252a95853a5c, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,44975,1696125669240; forceNewPlan=false, retain=false 2023-10-01 02:02:20,570 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=adcb3ce3b962d584401c4bb77a781fb9, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,43503,1696125669195; forceNewPlan=false, retain=false 2023-10-01 02:02:20,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-01 02:02:20,720 INFO [jenkins-hbase17:37789] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 02:02:20,723 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=898acd85864ff1983ffe252a95853a5c, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:20,723 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=adcb3ce3b962d584401c4bb77a781fb9, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:20,723 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740519.898acd85864ff1983ffe252a95853a5c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696125740723"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125740723"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125740723"}]},"ts":"1696125740723"} 2023-10-01 02:02:20,723 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696125740519.adcb3ce3b962d584401c4bb77a781fb9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696125740723"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125740723"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125740723"}]},"ts":"1696125740723"} 2023-10-01 02:02:20,725 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 898acd85864ff1983ffe252a95853a5c, server=jenkins-hbase17.apache.org,44975,1696125669240}] 2023-10-01 02:02:20,726 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure adcb3ce3b962d584401c4bb77a781fb9, server=jenkins-hbase17.apache.org,43503,1696125669195}] 2023-10-01 02:02:20,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-01 02:02:20,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740519.898acd85864ff1983ffe252a95853a5c. 2023-10-01 02:02:20,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 898acd85864ff1983ffe252a95853a5c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740519.898acd85864ff1983ffe252a95853a5c.', STARTKEY => '', ENDKEY => '2'} 2023-10-01 02:02:20,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1696125740519.adcb3ce3b962d584401c4bb77a781fb9. 2023-10-01 02:02:20,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => adcb3ce3b962d584401c4bb77a781fb9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696125740519.adcb3ce3b962d584401c4bb77a781fb9.', STARTKEY => '2', ENDKEY => ''} 2023-10-01 02:02:20,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740519.898acd85864ff1983ffe252a95853a5c. service=AccessControlService 2023-10-01 02:02:20,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1696125740519.adcb3ce3b962d584401c4bb77a781fb9. service=AccessControlService 2023-10-01 02:02:20,881 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 02:02:20,881 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 02:02:20,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 898acd85864ff1983ffe252a95853a5c 2023-10-01 02:02:20,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 adcb3ce3b962d584401c4bb77a781fb9 2023-10-01 02:02:20,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740519.898acd85864ff1983ffe252a95853a5c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:02:20,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696125740519.adcb3ce3b962d584401c4bb77a781fb9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:02:20,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 898acd85864ff1983ffe252a95853a5c 2023-10-01 02:02:20,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for adcb3ce3b962d584401c4bb77a781fb9 2023-10-01 02:02:20,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 898acd85864ff1983ffe252a95853a5c 2023-10-01 02:02:20,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for adcb3ce3b962d584401c4bb77a781fb9 2023-10-01 02:02:20,883 INFO [StoreOpener-adcb3ce3b962d584401c4bb77a781fb9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region adcb3ce3b962d584401c4bb77a781fb9 2023-10-01 02:02:20,883 INFO [StoreOpener-898acd85864ff1983ffe252a95853a5c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 898acd85864ff1983ffe252a95853a5c 2023-10-01 02:02:20,884 DEBUG [StoreOpener-898acd85864ff1983ffe252a95853a5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/898acd85864ff1983ffe252a95853a5c/cf 2023-10-01 02:02:20,884 DEBUG [StoreOpener-898acd85864ff1983ffe252a95853a5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/898acd85864ff1983ffe252a95853a5c/cf 2023-10-01 02:02:20,885 INFO [StoreOpener-898acd85864ff1983ffe252a95853a5c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 898acd85864ff1983ffe252a95853a5c columnFamilyName cf 2023-10-01 02:02:20,885 DEBUG [StoreOpener-adcb3ce3b962d584401c4bb77a781fb9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/adcb3ce3b962d584401c4bb77a781fb9/cf 2023-10-01 02:02:20,885 DEBUG [StoreOpener-adcb3ce3b962d584401c4bb77a781fb9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/adcb3ce3b962d584401c4bb77a781fb9/cf 2023-10-01 02:02:20,885 INFO [StoreOpener-898acd85864ff1983ffe252a95853a5c-1] regionserver.HStore(310): Store=898acd85864ff1983ffe252a95853a5c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 02:02:20,885 INFO [StoreOpener-adcb3ce3b962d584401c4bb77a781fb9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region adcb3ce3b962d584401c4bb77a781fb9 columnFamilyName cf 2023-10-01 02:02:20,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/898acd85864ff1983ffe252a95853a5c 2023-10-01 02:02:20,886 INFO [StoreOpener-adcb3ce3b962d584401c4bb77a781fb9-1] regionserver.HStore(310): Store=adcb3ce3b962d584401c4bb77a781fb9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 02:02:20,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/898acd85864ff1983ffe252a95853a5c 2023-10-01 02:02:20,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/adcb3ce3b962d584401c4bb77a781fb9 2023-10-01 02:02:20,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/adcb3ce3b962d584401c4bb77a781fb9 2023-10-01 02:02:20,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 898acd85864ff1983ffe252a95853a5c 2023-10-01 02:02:20,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for adcb3ce3b962d584401c4bb77a781fb9 2023-10-01 02:02:20,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/898acd85864ff1983ffe252a95853a5c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 02:02:20,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 898acd85864ff1983ffe252a95853a5c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68758196, jitterRate=0.024576961994171143}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 02:02:20,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 898acd85864ff1983ffe252a95853a5c: 2023-10-01 02:02:20,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/adcb3ce3b962d584401c4bb77a781fb9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 02:02:20,893 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened adcb3ce3b962d584401c4bb77a781fb9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59926632, jitterRate=-0.10702359676361084}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 02:02:20,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for adcb3ce3b962d584401c4bb77a781fb9: 2023-10-01 02:02:20,894 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696125740519.adcb3ce3b962d584401c4bb77a781fb9., pid=70, masterSystemTime=1696125740877 2023-10-01 02:02:20,894 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740519.898acd85864ff1983ffe252a95853a5c., pid=69, masterSystemTime=1696125740877 2023-10-01 02:02:20,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740519.898acd85864ff1983ffe252a95853a5c. 2023-10-01 02:02:20,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740519.898acd85864ff1983ffe252a95853a5c. 2023-10-01 02:02:20,896 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=898acd85864ff1983ffe252a95853a5c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:20,896 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740519.898acd85864ff1983ffe252a95853a5c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696125740896"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696125740896"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696125740896"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696125740896"}]},"ts":"1696125740896"} 2023-10-01 02:02:20,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696125740519.adcb3ce3b962d584401c4bb77a781fb9. 2023-10-01 02:02:20,897 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1696125740519.adcb3ce3b962d584401c4bb77a781fb9. 2023-10-01 02:02:20,898 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=adcb3ce3b962d584401c4bb77a781fb9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:20,898 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696125740519.adcb3ce3b962d584401c4bb77a781fb9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696125740898"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696125740898"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696125740898"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696125740898"}]},"ts":"1696125740898"} 2023-10-01 02:02:20,901 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-10-01 02:02:20,901 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 898acd85864ff1983ffe252a95853a5c, server=jenkins-hbase17.apache.org,44975,1696125669240 in 173 msec 2023-10-01 02:02:20,903 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-10-01 02:02:20,903 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=898acd85864ff1983ffe252a95853a5c, ASSIGN in 336 msec 2023-10-01 02:02:20,903 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure adcb3ce3b962d584401c4bb77a781fb9, server=jenkins-hbase17.apache.org,43503,1696125669195 in 174 msec 2023-10-01 02:02:20,905 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-10-01 02:02:20,905 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=adcb3ce3b962d584401c4bb77a781fb9, ASSIGN in 337 msec 2023-10-01 02:02:20,906 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 02:02:20,906 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125740906"}]},"ts":"1696125740906"} 2023-10-01 02:02:20,908 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-10-01 02:02:20,910 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 02:02:20,910 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-10-01 02:02:20,912 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45065] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-01 02:02:20,914 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:20,914 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:20,914 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:20,914 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:20,915 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 02:02:20,915 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 02:02:20,915 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-01 02:02:20,915 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 02:02:20,915 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-01 02:02:20,916 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-01 02:02:20,916 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 02:02:20,916 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-01 02:02:20,917 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 396 msec 2023-10-01 02:02:21,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-01 02:02:21,127 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-10-01 02:02:21,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.HMaster$2(1952): Client=jenkins//136.243.18.41 merge regions 898acd85864ff1983ffe252a95853a5c, adcb3ce3b962d584401c4bb77a781fb9 2023-10-01 02:02:21,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[898acd85864ff1983ffe252a95853a5c, adcb3ce3b962d584401c4bb77a781fb9], force=true 2023-10-01 02:02:21,159 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[898acd85864ff1983ffe252a95853a5c, adcb3ce3b962d584401c4bb77a781fb9], force=true 2023-10-01 02:02:21,159 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[898acd85864ff1983ffe252a95853a5c, adcb3ce3b962d584401c4bb77a781fb9], force=true 2023-10-01 02:02:21,159 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[898acd85864ff1983ffe252a95853a5c, adcb3ce3b962d584401c4bb77a781fb9], force=true 2023-10-01 02:02:21,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-01 02:02:21,181 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=898acd85864ff1983ffe252a95853a5c, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=adcb3ce3b962d584401c4bb77a781fb9, UNASSIGN}] 2023-10-01 02:02:21,184 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=898acd85864ff1983ffe252a95853a5c, UNASSIGN 2023-10-01 02:02:21,184 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=adcb3ce3b962d584401c4bb77a781fb9, UNASSIGN 2023-10-01 02:02:21,185 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=898acd85864ff1983ffe252a95853a5c, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:21,185 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=adcb3ce3b962d584401c4bb77a781fb9, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:21,185 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740519.898acd85864ff1983ffe252a95853a5c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696125741184"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125741184"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125741184"}]},"ts":"1696125741184"} 2023-10-01 02:02:21,185 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696125740519.adcb3ce3b962d584401c4bb77a781fb9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696125741184"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125741184"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125741184"}]},"ts":"1696125741184"} 2023-10-01 02:02:21,186 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 898acd85864ff1983ffe252a95853a5c, server=jenkins-hbase17.apache.org,44975,1696125669240}] 2023-10-01 02:02:21,187 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure adcb3ce3b962d584401c4bb77a781fb9, server=jenkins-hbase17.apache.org,43503,1696125669195}] 2023-10-01 02:02:21,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-01 02:02:21,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 898acd85864ff1983ffe252a95853a5c 2023-10-01 02:02:21,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 898acd85864ff1983ffe252a95853a5c, disabling compactions & flushes 2023-10-01 02:02:21,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740519.898acd85864ff1983ffe252a95853a5c. 2023-10-01 02:02:21,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740519.898acd85864ff1983ffe252a95853a5c. 2023-10-01 02:02:21,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740519.898acd85864ff1983ffe252a95853a5c. after waiting 0 ms 2023-10-01 02:02:21,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740519.898acd85864ff1983ffe252a95853a5c. 2023-10-01 02:02:21,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 898acd85864ff1983ffe252a95853a5c 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-01 02:02:21,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close adcb3ce3b962d584401c4bb77a781fb9 2023-10-01 02:02:21,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing adcb3ce3b962d584401c4bb77a781fb9, disabling compactions & flushes 2023-10-01 02:02:21,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696125740519.adcb3ce3b962d584401c4bb77a781fb9. 2023-10-01 02:02:21,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696125740519.adcb3ce3b962d584401c4bb77a781fb9. 2023-10-01 02:02:21,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696125740519.adcb3ce3b962d584401c4bb77a781fb9. after waiting 0 ms 2023-10-01 02:02:21,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696125740519.adcb3ce3b962d584401c4bb77a781fb9. 2023-10-01 02:02:21,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing adcb3ce3b962d584401c4bb77a781fb9 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-01 02:02:21,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/898acd85864ff1983ffe252a95853a5c/.tmp/cf/6a4a76f10f5c4764969d7e9ea316753e 2023-10-01 02:02:21,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/adcb3ce3b962d584401c4bb77a781fb9/.tmp/cf/4c0ebe01b6dc43809d1240d38d8fa6d8 2023-10-01 02:02:21,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/898acd85864ff1983ffe252a95853a5c/.tmp/cf/6a4a76f10f5c4764969d7e9ea316753e as hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/898acd85864ff1983ffe252a95853a5c/cf/6a4a76f10f5c4764969d7e9ea316753e 2023-10-01 02:02:21,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/adcb3ce3b962d584401c4bb77a781fb9/.tmp/cf/4c0ebe01b6dc43809d1240d38d8fa6d8 as hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/adcb3ce3b962d584401c4bb77a781fb9/cf/4c0ebe01b6dc43809d1240d38d8fa6d8 2023-10-01 02:02:21,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/898acd85864ff1983ffe252a95853a5c/cf/6a4a76f10f5c4764969d7e9ea316753e, entries=1, sequenceid=5, filesize=4.7 K 2023-10-01 02:02:21,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/adcb3ce3b962d584401c4bb77a781fb9/cf/4c0ebe01b6dc43809d1240d38d8fa6d8, entries=1, sequenceid=5, filesize=4.7 K 2023-10-01 02:02:21,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for adcb3ce3b962d584401c4bb77a781fb9 in 39ms, sequenceid=5, compaction requested=false 2023-10-01 02:02:21,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-01 02:02:21,385 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 898acd85864ff1983ffe252a95853a5c in 45ms, sequenceid=5, compaction requested=false 2023-10-01 02:02:21,394 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/898acd85864ff1983ffe252a95853a5c/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-01 02:02:21,394 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/adcb3ce3b962d584401c4bb77a781fb9/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-01 02:02:21,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 02:02:21,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 02:02:21,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740519.898acd85864ff1983ffe252a95853a5c. 2023-10-01 02:02:21,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696125740519.adcb3ce3b962d584401c4bb77a781fb9. 2023-10-01 02:02:21,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 898acd85864ff1983ffe252a95853a5c: 2023-10-01 02:02:21,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for adcb3ce3b962d584401c4bb77a781fb9: 2023-10-01 02:02:21,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed adcb3ce3b962d584401c4bb77a781fb9 2023-10-01 02:02:21,397 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=adcb3ce3b962d584401c4bb77a781fb9, regionState=CLOSED 2023-10-01 02:02:21,397 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696125740519.adcb3ce3b962d584401c4bb77a781fb9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696125741397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125741397"}]},"ts":"1696125741397"} 2023-10-01 02:02:21,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 898acd85864ff1983ffe252a95853a5c 2023-10-01 02:02:21,398 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=898acd85864ff1983ffe252a95853a5c, regionState=CLOSED 2023-10-01 02:02:21,398 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740519.898acd85864ff1983ffe252a95853a5c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696125741398"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125741398"}]},"ts":"1696125741398"} 2023-10-01 02:02:21,400 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-10-01 02:02:21,400 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure adcb3ce3b962d584401c4bb77a781fb9, server=jenkins-hbase17.apache.org,43503,1696125669195 in 212 msec 2023-10-01 02:02:21,401 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-10-01 02:02:21,401 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 898acd85864ff1983ffe252a95853a5c, server=jenkins-hbase17.apache.org,44975,1696125669240 in 213 msec 2023-10-01 02:02:21,401 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=adcb3ce3b962d584401c4bb77a781fb9, UNASSIGN in 219 msec 2023-10-01 02:02:21,403 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-10-01 02:02:21,403 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=898acd85864ff1983ffe252a95853a5c, UNASSIGN in 223 msec 2023-10-01 02:02:21,445 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e9f3a667a947d33ef50251724714e10/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-10-01 02:02:21,447 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740519.898acd85864ff1983ffe252a95853a5c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-01 02:02:21,447 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696125740519.adcb3ce3b962d584401c4bb77a781fb9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-01 02:02:21,447 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740520.4e9f3a667a947d33ef50251724714e10.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-01 02:02:21,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-01 02:02:21,490 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4e9f3a667a947d33ef50251724714e10, ASSIGN}] 2023-10-01 02:02:21,492 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4e9f3a667a947d33ef50251724714e10, ASSIGN 2023-10-01 02:02:21,492 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4e9f3a667a947d33ef50251724714e10, ASSIGN; state=MERGED, location=jenkins-hbase17.apache.org,44975,1696125669240; forceNewPlan=false, retain=false 2023-10-01 02:02:21,643 INFO [jenkins-hbase17:37789] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-01 02:02:21,645 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4e9f3a667a947d33ef50251724714e10, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:21,645 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740520.4e9f3a667a947d33ef50251724714e10.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696125741645"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125741645"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125741645"}]},"ts":"1696125741645"} 2023-10-01 02:02:21,646 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 4e9f3a667a947d33ef50251724714e10, server=jenkins-hbase17.apache.org,44975,1696125669240}] 2023-10-01 02:02:21,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-01 02:02:21,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740520.4e9f3a667a947d33ef50251724714e10. 2023-10-01 02:02:21,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4e9f3a667a947d33ef50251724714e10, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740520.4e9f3a667a947d33ef50251724714e10.', STARTKEY => '', ENDKEY => ''} 2023-10-01 02:02:21,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740520.4e9f3a667a947d33ef50251724714e10. service=AccessControlService 2023-10-01 02:02:21,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 02:02:21,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 4e9f3a667a947d33ef50251724714e10 2023-10-01 02:02:21,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740520.4e9f3a667a947d33ef50251724714e10.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:02:21,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 4e9f3a667a947d33ef50251724714e10 2023-10-01 02:02:21,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 4e9f3a667a947d33ef50251724714e10 2023-10-01 02:02:21,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e9f3a667a947d33ef50251724714e10/.regioninfo 2023-10-01 02:02:21,812 INFO [StoreOpener-4e9f3a667a947d33ef50251724714e10-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4e9f3a667a947d33ef50251724714e10 2023-10-01 02:02:21,813 DEBUG [StoreOpener-4e9f3a667a947d33ef50251724714e10-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e9f3a667a947d33ef50251724714e10/cf 2023-10-01 02:02:21,813 DEBUG [StoreOpener-4e9f3a667a947d33ef50251724714e10-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e9f3a667a947d33ef50251724714e10/cf 2023-10-01 02:02:21,813 INFO [StoreOpener-4e9f3a667a947d33ef50251724714e10-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e9f3a667a947d33ef50251724714e10 columnFamilyName cf 2023-10-01 02:02:21,841 DEBUG [StoreOpener-4e9f3a667a947d33ef50251724714e10-1] regionserver.HStore(539): loaded hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e9f3a667a947d33ef50251724714e10/cf/4c0ebe01b6dc43809d1240d38d8fa6d8.adcb3ce3b962d584401c4bb77a781fb9->hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/adcb3ce3b962d584401c4bb77a781fb9/cf/4c0ebe01b6dc43809d1240d38d8fa6d8-top 2023-10-01 02:02:21,847 DEBUG [StoreOpener-4e9f3a667a947d33ef50251724714e10-1] regionserver.HStore(539): loaded hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e9f3a667a947d33ef50251724714e10/cf/6a4a76f10f5c4764969d7e9ea316753e.898acd85864ff1983ffe252a95853a5c->hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/898acd85864ff1983ffe252a95853a5c/cf/6a4a76f10f5c4764969d7e9ea316753e-top 2023-10-01 02:02:21,848 INFO [StoreOpener-4e9f3a667a947d33ef50251724714e10-1] regionserver.HStore(310): Store=4e9f3a667a947d33ef50251724714e10/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 02:02:21,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e9f3a667a947d33ef50251724714e10 2023-10-01 02:02:21,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e9f3a667a947d33ef50251724714e10 2023-10-01 02:02:21,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 4e9f3a667a947d33ef50251724714e10 2023-10-01 02:02:21,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 4e9f3a667a947d33ef50251724714e10; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69316542, jitterRate=0.032896965742111206}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 02:02:21,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 4e9f3a667a947d33ef50251724714e10: 2023-10-01 02:02:21,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740520.4e9f3a667a947d33ef50251724714e10., pid=77, masterSystemTime=1696125741798 2023-10-01 02:02:21,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740520.4e9f3a667a947d33ef50251724714e10.,because compaction is disabled. 2023-10-01 02:02:21,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740520.4e9f3a667a947d33ef50251724714e10. 2023-10-01 02:02:21,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740520.4e9f3a667a947d33ef50251724714e10. 2023-10-01 02:02:21,857 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4e9f3a667a947d33ef50251724714e10, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:21,857 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740520.4e9f3a667a947d33ef50251724714e10.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696125741857"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696125741857"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696125741857"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696125741857"}]},"ts":"1696125741857"} 2023-10-01 02:02:21,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-01 02:02:21,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 4e9f3a667a947d33ef50251724714e10, server=jenkins-hbase17.apache.org,44975,1696125669240 in 212 msec 2023-10-01 02:02:21,861 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-10-01 02:02:21,861 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4e9f3a667a947d33ef50251724714e10, ASSIGN in 370 msec 2023-10-01 02:02:21,863 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[898acd85864ff1983ffe252a95853a5c, adcb3ce3b962d584401c4bb77a781fb9], force=true in 709 msec 2023-10-01 02:02:22,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-01 02:02:22,267 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-10-01 02:02:22,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-01 02:02:22,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696125742268 (current time:1696125742268). 2023-10-01 02:02:22,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 02:02:22,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(139): Connect 0x24a47893 to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:02:22,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1175f1cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:02:22,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:02:22,280 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:39602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:02:22,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24a47893 to 127.0.0.1:51733 2023-10-01 02:02:22,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:02:22,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(139): Connect 0x2a88612e to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:02:22,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2defe40c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:02:22,290 DEBUG [hconnection-0x132a8bec-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:02:22,293 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:39612, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:02:22,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:02:22,300 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:45792, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:02:22,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a88612e to 127.0.0.1:51733 2023-10-01 02:02:22,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:02:22,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-01 02:02:22,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 02:02:22,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-01 02:02:22,305 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot, current working dir path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 02:02:22,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-01 02:02:22,307 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-01 02:02:22,308 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1696126342308 2023-10-01 02:02:22,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-01 02:02:22,308 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,311 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 02:02:22,311 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 02:02:22,313 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-01 02:02:22,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-01 02:02:22,314 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 8 msec 2023-10-01 02:02:22,315 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-01 02:02:22,315 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1696126342315 2023-10-01 02:02:22,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,324 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-10-01 02:02:22,324 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:22,325 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-10-01 02:02:22,325 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-10-01 02:02:22,325 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,326 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,326 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:22,326 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:22,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:22,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:22,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:22,326 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:22,326 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:22,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:22,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:22,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:22,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,327 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:22,327 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 02:02:22,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,327 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,327 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-01 02:02:22,327 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-01 02:02:22,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-01 02:02:22,328 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-01 02:02:22,328 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-01 02:02:22,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,328 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,328 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-01 02:02:22,328 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-01 02:02:22,328 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:22,329 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,330 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,330 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-01 02:02:22,330 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-01 02:02:22,331 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-01 02:02:22,331 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:22,331 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-01 02:02:22,332 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:22,332 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-01 02:02:22,333 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-01 02:02:22,333 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44975,1696125669240' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-01 02:02:22,331 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,43503,1696125669195' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-01 02:02:22,333 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-01 02:02:22,333 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-01 02:02:22,333 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,45065,1696125669145' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-01 02:02:22,337 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,337 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,338 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:22,337 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:22,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:22,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:22,338 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,338 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:02:22,338 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,338 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:02:22,338 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,338 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:02:22,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:22,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:22,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:22,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:22,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:22,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:22,340 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44975,1696125669240' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-10-01 02:02:22,340 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@380b14d3[Count = 0] remaining members to acquire global barrier 2023-10-01 02:02:22,340 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-10-01 02:02:22,340 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,340 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,340 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,340 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,341 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:22,341 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 02:02:22,341 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-01 02:02:22,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,341 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-01 02:02:22,341 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-01 02:02:22,341 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase17.apache.org,43503,1696125669195' in zk 2023-10-01 02:02:22,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,341 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-01 02:02:22,341 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-01 02:02:22,341 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase17.apache.org,45065,1696125669145' in zk 2023-10-01 02:02:22,341 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740520.4e9f3a667a947d33ef50251724714e10. 2023-10-01 02:02:22,341 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 02:02:22,341 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 02:02:22,341 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740520.4e9f3a667a947d33ef50251724714e10. started... 2023-10-01 02:02:22,343 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4e9f3a667a947d33ef50251724714e10: 2023-10-01 02:02:22,343 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-01 02:02:22,343 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:22,343 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740520.4e9f3a667a947d33ef50251724714e10.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,343 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-01 02:02:22,344 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 02:02:22,344 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-01 02:02:22,344 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:22,344 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-01 02:02:22,344 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e9f3a667a947d33ef50251724714e10/cf/4c0ebe01b6dc43809d1240d38d8fa6d8.adcb3ce3b962d584401c4bb77a781fb9->hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/adcb3ce3b962d584401c4bb77a781fb9/cf/4c0ebe01b6dc43809d1240d38d8fa6d8-top, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e9f3a667a947d33ef50251724714e10/cf/6a4a76f10f5c4764969d7e9ea316753e.898acd85864ff1983ffe252a95853a5c->hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/898acd85864ff1983ffe252a95853a5c/cf/6a4a76f10f5c4764969d7e9ea316753e-top] hfiles 2023-10-01 02:02:22,348 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e9f3a667a947d33ef50251724714e10/cf/4c0ebe01b6dc43809d1240d38d8fa6d8.adcb3ce3b962d584401c4bb77a781fb9 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,349 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e9f3a667a947d33ef50251724714e10/cf/6a4a76f10f5c4764969d7e9ea316753e.898acd85864ff1983ffe252a95853a5c for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,356 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740520.4e9f3a667a947d33ef50251724714e10. completed. 2023-10-01 02:02:22,356 DEBUG [rs(jenkins-hbase17.apache.org,44975,1696125669240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740520.4e9f3a667a947d33ef50251724714e10. 2023-10-01 02:02:22,356 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 02:02:22,356 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 02:02:22,356 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:22,356 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-01 02:02:22,356 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase17.apache.org,44975,1696125669240' in zk 2023-10-01 02:02:22,359 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-01 02:02:22,359 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:22,359 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:22,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:22,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:22,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:22,359 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-01 02:02:22,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:22,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:22,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:22,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:22,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:22,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:22,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:22,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:22,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:22,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase17.apache.org,44975,1696125669240': 2023-10-01 02:02:22,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44975,1696125669240' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-10-01 02:02:22,361 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-10-01 02:02:22,361 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 02:02:22,361 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 02:02:22,361 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,361 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 02:02:22,362 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,362 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,363 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,363 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,363 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:22,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:22,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:22,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,363 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:22,363 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:22,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,363 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:22,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,363 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:22,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:22,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:22,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:22,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,363 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:22,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:22,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:22,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:22,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:22,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:22,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:22,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:22,365 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:22,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:22,365 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:22,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:22,365 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:22,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:22,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:22,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:22,367 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:22,368 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,368 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:22,368 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:22,368 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:22,368 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:22,368 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:22,368 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:22,368 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:22,368 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:22,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:22,368 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,368 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:22,368 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:22,368 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:22,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:22,368 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:22,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:22,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:22,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:22,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:22,368 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,368 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:22,369 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:22,369 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,369 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:22,369 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:22,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:22,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:22,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,391 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-10-01 02:02:22,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,392 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1696125742308Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696125742368 (+60 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696125742368Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696125742371 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696125742383 (+12 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1696125742391 (+8 ms) 2023-10-01 02:02:22,395 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-01 02:02:22,396 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 84 msec 2023-10-01 02:02:22,412 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 02:02:22,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-01 02:02:22,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 02:02:22,413 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125742413 2023-10-01 02:02:22,413 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33385, tgtDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125742413, rawTgtDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125742413, srcFsUri=hdfs://localhost:33385, srcDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae 2023-10-01 02:02:22,430 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33385, inputRoot=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae 2023-10-01 02:02:22,430 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1216006641_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125742413, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125742413/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,430 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33385, inputRoot=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae, snapshotDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-10-01 02:02:22,438 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125742413/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:22,456 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:22,456 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:22,457 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:22,457 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:23,171 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/hadoop-190600084712879605.jar 2023-10-01 02:02:23,172 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:23,172 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:23,226 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/hadoop-6203163674126525147.jar 2023-10-01 02:02:23,227 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:23,227 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:23,227 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:23,228 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:23,228 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:23,228 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:23,229 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 02:02:23,229 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 02:02:23,230 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 02:02:23,230 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 02:02:23,230 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 02:02:23,231 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 02:02:23,231 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 02:02:23,231 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 02:02:23,231 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 02:02:23,232 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 02:02:23,232 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:02:23,233 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:02:23,233 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 02:02:23,233 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:02:23,233 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:02:23,234 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 02:02:23,234 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 02:02:23,551 WARN [Listener at jenkins-hbase17.apache.org/41447] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 02:02:23,553 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-10-01 02:02:23,555 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-10-01 02:02:23,656 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 02:02:23,656 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 02:02:23,659 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0004_000001 (auth:SIMPLE) 2023-10-01 02:02:24,436 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 02:02:24,603 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0005_000001 (auth:SIMPLE) 2023-10-01 02:02:27,990 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0005_000001 (auth:SIMPLE) 2023-10-01 02:02:30,188 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0005_000001 (auth:SIMPLE) 2023-10-01 02:02:32,321 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0005_000001 (auth:SIMPLE) 2023-10-01 02:02:33,717 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 02:02:33,720 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 02:02:33,727 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:33,727 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 02:02:33,728 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 02:02:33,728 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-403693088_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:33,728 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-01 02:02:33,728 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-01 02:02:33,728 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-403693088_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125742413/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125742413/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:33,729 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125742413/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-01 02:02:33,729 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125742413/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-01 02:02:33,736 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:33,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:33,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:33,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-01 02:02:33,740 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125753740"}]},"ts":"1696125753740"} 2023-10-01 02:02:33,741 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-10-01 02:02:33,742 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-10-01 02:02:33,743 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4e9f3a667a947d33ef50251724714e10, UNASSIGN}] 2023-10-01 02:02:33,744 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4e9f3a667a947d33ef50251724714e10, UNASSIGN 2023-10-01 02:02:33,745 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=4e9f3a667a947d33ef50251724714e10, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:33,745 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740520.4e9f3a667a947d33ef50251724714e10.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696125753745"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125753745"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125753745"}]},"ts":"1696125753745"} 2023-10-01 02:02:33,747 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 4e9f3a667a947d33ef50251724714e10, server=jenkins-hbase17.apache.org,44975,1696125669240}] 2023-10-01 02:02:33,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-01 02:02:33,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 4e9f3a667a947d33ef50251724714e10 2023-10-01 02:02:33,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 4e9f3a667a947d33ef50251724714e10, disabling compactions & flushes 2023-10-01 02:02:33,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740520.4e9f3a667a947d33ef50251724714e10. 2023-10-01 02:02:33,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740520.4e9f3a667a947d33ef50251724714e10. 2023-10-01 02:02:33,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740520.4e9f3a667a947d33ef50251724714e10. after waiting 0 ms 2023-10-01 02:02:33,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740520.4e9f3a667a947d33ef50251724714e10. 2023-10-01 02:02:33,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e9f3a667a947d33ef50251724714e10/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-10-01 02:02:33,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 02:02:33,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740520.4e9f3a667a947d33ef50251724714e10. 2023-10-01 02:02:33,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 4e9f3a667a947d33ef50251724714e10: 2023-10-01 02:02:33,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 4e9f3a667a947d33ef50251724714e10 2023-10-01 02:02:33,913 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=4e9f3a667a947d33ef50251724714e10, regionState=CLOSED 2023-10-01 02:02:33,914 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740520.4e9f3a667a947d33ef50251724714e10.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696125753913"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125753913"}]},"ts":"1696125753913"} 2023-10-01 02:02:33,916 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-10-01 02:02:33,916 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 4e9f3a667a947d33ef50251724714e10, server=jenkins-hbase17.apache.org,44975,1696125669240 in 168 msec 2023-10-01 02:02:33,917 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-10-01 02:02:33,917 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4e9f3a667a947d33ef50251724714e10, UNASSIGN in 174 msec 2023-10-01 02:02:33,918 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125753918"}]},"ts":"1696125753918"} 2023-10-01 02:02:33,919 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-10-01 02:02:33,920 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-10-01 02:02:33,922 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 185 msec 2023-10-01 02:02:34,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-01 02:02:34,042 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-10-01 02:02:34,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:34,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:34,046 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:34,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:34,046 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:34,047 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45065] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:34,049 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:34,049 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:34,049 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:34,049 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:34,049 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-01 02:02:34,049 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-01 02:02:34,050 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-01 02:02:34,050 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-01 02:02:34,050 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:34,050 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:34,050 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:34,050 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e9f3a667a947d33ef50251724714e10 2023-10-01 02:02:34,050 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/898acd85864ff1983ffe252a95853a5c 2023-10-01 02:02:34,050 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:34,050 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:34,050 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:34,050 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/adcb3ce3b962d584401c4bb77a781fb9 2023-10-01 02:02:34,050 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:34,050 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:34,051 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 02:02:34,051 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 02:02:34,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-01 02:02:34,052 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 02:02:34,052 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 02:02:34,053 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e9f3a667a947d33ef50251724714e10/cf, FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e9f3a667a947d33ef50251724714e10/recovered.edits] 2023-10-01 02:02:34,053 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/898acd85864ff1983ffe252a95853a5c/cf, FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/898acd85864ff1983ffe252a95853a5c/recovered.edits] 2023-10-01 02:02:34,053 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/adcb3ce3b962d584401c4bb77a781fb9/cf, FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/adcb3ce3b962d584401c4bb77a781fb9/recovered.edits] 2023-10-01 02:02:34,056 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/adcb3ce3b962d584401c4bb77a781fb9/cf/4c0ebe01b6dc43809d1240d38d8fa6d8 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/adcb3ce3b962d584401c4bb77a781fb9/cf/4c0ebe01b6dc43809d1240d38d8fa6d8 2023-10-01 02:02:34,056 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e9f3a667a947d33ef50251724714e10/cf/4c0ebe01b6dc43809d1240d38d8fa6d8.adcb3ce3b962d584401c4bb77a781fb9 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e9f3a667a947d33ef50251724714e10/cf/4c0ebe01b6dc43809d1240d38d8fa6d8.adcb3ce3b962d584401c4bb77a781fb9 2023-10-01 02:02:34,056 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/898acd85864ff1983ffe252a95853a5c/cf/6a4a76f10f5c4764969d7e9ea316753e to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/898acd85864ff1983ffe252a95853a5c/cf/6a4a76f10f5c4764969d7e9ea316753e 2023-10-01 02:02:34,057 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e9f3a667a947d33ef50251724714e10/cf/6a4a76f10f5c4764969d7e9ea316753e.898acd85864ff1983ffe252a95853a5c to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e9f3a667a947d33ef50251724714e10/cf/6a4a76f10f5c4764969d7e9ea316753e.898acd85864ff1983ffe252a95853a5c 2023-10-01 02:02:34,059 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/adcb3ce3b962d584401c4bb77a781fb9/recovered.edits/8.seqid to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/adcb3ce3b962d584401c4bb77a781fb9/recovered.edits/8.seqid 2023-10-01 02:02:34,059 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/898acd85864ff1983ffe252a95853a5c/recovered.edits/8.seqid to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/898acd85864ff1983ffe252a95853a5c/recovered.edits/8.seqid 2023-10-01 02:02:34,059 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/adcb3ce3b962d584401c4bb77a781fb9 2023-10-01 02:02:34,059 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/898acd85864ff1983ffe252a95853a5c 2023-10-01 02:02:34,060 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e9f3a667a947d33ef50251724714e10/recovered.edits/12.seqid to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e9f3a667a947d33ef50251724714e10/recovered.edits/12.seqid 2023-10-01 02:02:34,060 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e9f3a667a947d33ef50251724714e10 2023-10-01 02:02:34,060 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-01 02:02:34,063 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:34,065 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-10-01 02:02:34,067 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-10-01 02:02:34,068 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:34,068 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-10-01 02:02:34,068 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740520.4e9f3a667a947d33ef50251724714e10.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696125754068"}]},"ts":"9223372036854775807"} 2023-10-01 02:02:34,070 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-01 02:02:34,070 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4e9f3a667a947d33ef50251724714e10, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696125740520.4e9f3a667a947d33ef50251724714e10.', STARTKEY => '', ENDKEY => ''}] 2023-10-01 02:02:34,070 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-10-01 02:02:34,070 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696125754070"}]},"ts":"9223372036854775807"} 2023-10-01 02:02:34,072 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-10-01 02:02:34,073 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:34,075 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 31 msec 2023-10-01 02:02:34,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-01 02:02:34,153 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-10-01 02:02:34,153 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:34,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:34,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:34,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-01 02:02:34,158 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125754158"}]},"ts":"1696125754158"} 2023-10-01 02:02:34,159 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-10-01 02:02:34,160 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-10-01 02:02:34,161 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3d776b80c2306b4723aec32a7587e914, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b42ca06b55ea659e9606e11ce42b8aa9, UNASSIGN}] 2023-10-01 02:02:34,163 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b42ca06b55ea659e9606e11ce42b8aa9, UNASSIGN 2023-10-01 02:02:34,163 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3d776b80c2306b4723aec32a7587e914, UNASSIGN 2023-10-01 02:02:34,164 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=b42ca06b55ea659e9606e11ce42b8aa9, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:34,164 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=3d776b80c2306b4723aec32a7587e914, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:34,164 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696125754163"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125754163"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125754163"}]},"ts":"1696125754163"} 2023-10-01 02:02:34,164 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696125754163"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125754163"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125754163"}]},"ts":"1696125754163"} 2023-10-01 02:02:34,165 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 3d776b80c2306b4723aec32a7587e914, server=jenkins-hbase17.apache.org,45065,1696125669145}] 2023-10-01 02:02:34,166 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure b42ca06b55ea659e9606e11ce42b8aa9, server=jenkins-hbase17.apache.org,44975,1696125669240}] 2023-10-01 02:02:34,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-01 02:02:34,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 3d776b80c2306b4723aec32a7587e914 2023-10-01 02:02:34,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 3d776b80c2306b4723aec32a7587e914, disabling compactions & flushes 2023-10-01 02:02:34,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914. 2023-10-01 02:02:34,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914. 2023-10-01 02:02:34,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914. after waiting 0 ms 2023-10-01 02:02:34,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914. 2023-10-01 02:02:34,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close b42ca06b55ea659e9606e11ce42b8aa9 2023-10-01 02:02:34,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing b42ca06b55ea659e9606e11ce42b8aa9, disabling compactions & flushes 2023-10-01 02:02:34,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9. 2023-10-01 02:02:34,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9. 2023-10-01 02:02:34,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9. after waiting 0 ms 2023-10-01 02:02:34,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9. 2023-10-01 02:02:34,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d776b80c2306b4723aec32a7587e914/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 02:02:34,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithMergeRegion/b42ca06b55ea659e9606e11ce42b8aa9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 02:02:34,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 02:02:34,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 02:02:34,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914. 2023-10-01 02:02:34,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9. 2023-10-01 02:02:34,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for b42ca06b55ea659e9606e11ce42b8aa9: 2023-10-01 02:02:34,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 3d776b80c2306b4723aec32a7587e914: 2023-10-01 02:02:34,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed b42ca06b55ea659e9606e11ce42b8aa9 2023-10-01 02:02:34,333 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=b42ca06b55ea659e9606e11ce42b8aa9, regionState=CLOSED 2023-10-01 02:02:34,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 3d776b80c2306b4723aec32a7587e914 2023-10-01 02:02:34,334 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696125754333"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125754333"}]},"ts":"1696125754333"} 2023-10-01 02:02:34,334 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=3d776b80c2306b4723aec32a7587e914, regionState=CLOSED 2023-10-01 02:02:34,334 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696125754334"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125754334"}]},"ts":"1696125754334"} 2023-10-01 02:02:34,336 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-10-01 02:02:34,336 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure b42ca06b55ea659e9606e11ce42b8aa9, server=jenkins-hbase17.apache.org,44975,1696125669240 in 169 msec 2023-10-01 02:02:34,337 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-10-01 02:02:34,337 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 3d776b80c2306b4723aec32a7587e914, server=jenkins-hbase17.apache.org,45065,1696125669145 in 170 msec 2023-10-01 02:02:34,341 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b42ca06b55ea659e9606e11ce42b8aa9, UNASSIGN in 175 msec 2023-10-01 02:02:34,342 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-10-01 02:02:34,342 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3d776b80c2306b4723aec32a7587e914, UNASSIGN in 176 msec 2023-10-01 02:02:34,342 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125754342"}]},"ts":"1696125754342"} 2023-10-01 02:02:34,343 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-10-01 02:02:34,344 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-10-01 02:02:34,350 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 195 msec 2023-10-01 02:02:34,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-01 02:02:34,460 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-10-01 02:02:34,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:34,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:34,463 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:34,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:34,464 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:34,465 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45065] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:34,468 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d776b80c2306b4723aec32a7587e914 2023-10-01 02:02:34,468 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b42ca06b55ea659e9606e11ce42b8aa9 2023-10-01 02:02:34,470 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b42ca06b55ea659e9606e11ce42b8aa9/cf, FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b42ca06b55ea659e9606e11ce42b8aa9/recovered.edits] 2023-10-01 02:02:34,470 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d776b80c2306b4723aec32a7587e914/cf, FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d776b80c2306b4723aec32a7587e914/recovered.edits] 2023-10-01 02:02:34,473 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b42ca06b55ea659e9606e11ce42b8aa9/cf/ed6079e5d0054ebb81bc560222272947 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/b42ca06b55ea659e9606e11ce42b8aa9/cf/ed6079e5d0054ebb81bc560222272947 2023-10-01 02:02:34,473 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d776b80c2306b4723aec32a7587e914/cf/e024198ea70647449964cac71667ad73 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d776b80c2306b4723aec32a7587e914/cf/e024198ea70647449964cac71667ad73 2023-10-01 02:02:34,475 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b42ca06b55ea659e9606e11ce42b8aa9/recovered.edits/9.seqid to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/b42ca06b55ea659e9606e11ce42b8aa9/recovered.edits/9.seqid 2023-10-01 02:02:34,475 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d776b80c2306b4723aec32a7587e914/recovered.edits/9.seqid to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d776b80c2306b4723aec32a7587e914/recovered.edits/9.seqid 2023-10-01 02:02:34,476 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b42ca06b55ea659e9606e11ce42b8aa9 2023-10-01 02:02:34,476 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3d776b80c2306b4723aec32a7587e914 2023-10-01 02:02:34,476 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-01 02:02:34,476 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-01 02:02:34,477 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-10-01 02:02:34,480 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310018e80b92ae24f4f65b519ae9037d85f29 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310018e80b92ae24f4f65b519ae9037d85f29 2023-10-01 02:02:34,481 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231001e7cca5b51f894a7a83663440b3e8caaf to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231001e7cca5b51f894a7a83663440b3e8caaf 2023-10-01 02:02:34,482 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-01 02:02:34,484 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:34,486 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-10-01 02:02:34,487 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:34,487 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:34,487 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:34,487 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:34,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-01 02:02:34,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-01 02:02:34,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-01 02:02:34,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-01 02:02:34,488 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:34,488 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:34,488 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:34,488 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:34,488 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:34,488 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:34,488 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:34,488 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:34,488 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-10-01 02:02:34,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-01 02:02:34,489 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:34,489 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-10-01 02:02:34,489 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696125754489"}]},"ts":"9223372036854775807"} 2023-10-01 02:02:34,489 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696125754489"}]},"ts":"9223372036854775807"} 2023-10-01 02:02:34,491 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 02:02:34,491 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3d776b80c2306b4723aec32a7587e914, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696125739154.3d776b80c2306b4723aec32a7587e914.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b42ca06b55ea659e9606e11ce42b8aa9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696125739154.b42ca06b55ea659e9606e11ce42b8aa9.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 02:02:34,491 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-10-01 02:02:34,491 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696125754491"}]},"ts":"9223372036854775807"} 2023-10-01 02:02:34,492 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-10-01 02:02:34,494 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:34,495 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 33 msec 2023-10-01 02:02:34,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-01 02:02:34,590 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-10-01 02:02:34,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-01 02:02:34,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:34,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-01 02:02:34,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 02:02:34,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-10-01 02:02:34,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 02:02:34,630 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=762 (was 754) Potentially hanging thread: hconnection-0x74c15b32-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74c15b32-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-792436436_1 at /127.0.0.1:48974 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74c15b32-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3956 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74c15b32-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-403693088_17 at /127.0.0.1:48986 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-403693088_17 at /127.0.0.1:53620 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-792436436_1 at /127.0.0.1:53596 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74c15b32-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74c15b32-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-403693088_17 at /127.0.0.1:52306 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-403693088_17 at /127.0.0.1:52296 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1111612899) connection to jenkins-hbase17.apache.org/136.243.18.41:39247 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=917 (was 921), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=263 (was 266), ProcessCount=179 (was 179), AvailableMemoryMB=8551 (was 8628) 2023-10-01 02:02:34,630 WARN [Listener at jenkins-hbase17.apache.org/41447] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-10-01 02:02:34,646 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=762, OpenFileDescriptor=917, MaxFileDescriptor=60000, SystemLoadAverage=263, ProcessCount=179, AvailableMemoryMB=8550 2023-10-01 02:02:34,646 WARN [Listener at jenkins-hbase17.apache.org/41447] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-10-01 02:02:34,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 02:02:34,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 02:02:34,651 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 02:02:34,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-10-01 02:02:34,652 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 02:02:34,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-01 02:02:34,654 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/ef837e043abef1a6c8661dc52b31ceab 2023-10-01 02:02:34,654 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/a66d8721ff7570b6cd367f8db32a9afb 2023-10-01 02:02:34,654 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/ef837e043abef1a6c8661dc52b31ceab empty. 2023-10-01 02:02:34,654 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/a66d8721ff7570b6cd367f8db32a9afb empty. 2023-10-01 02:02:34,655 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/ef837e043abef1a6c8661dc52b31ceab 2023-10-01 02:02:34,655 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/a66d8721ff7570b6cd367f8db32a9afb 2023-10-01 02:02:34,655 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-01 02:02:34,662 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-01 02:02:34,664 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => a66d8721ff7570b6cd367f8db32a9afb, NAME => 'testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp 2023-10-01 02:02:34,664 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => ef837e043abef1a6c8661dc52b31ceab, NAME => 'testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp 2023-10-01 02:02:34,686 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:02:34,686 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:02:34,687 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing ef837e043abef1a6c8661dc52b31ceab, disabling compactions & flushes 2023-10-01 02:02:34,687 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing a66d8721ff7570b6cd367f8db32a9afb, disabling compactions & flushes 2023-10-01 02:02:34,687 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab. 2023-10-01 02:02:34,687 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb. 2023-10-01 02:02:34,687 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab. 2023-10-01 02:02:34,687 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb. 2023-10-01 02:02:34,687 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab. after waiting 0 ms 2023-10-01 02:02:34,687 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb. after waiting 0 ms 2023-10-01 02:02:34,687 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab. 2023-10-01 02:02:34,687 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb. 2023-10-01 02:02:34,687 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab. 2023-10-01 02:02:34,687 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb. 2023-10-01 02:02:34,687 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for ef837e043abef1a6c8661dc52b31ceab: 2023-10-01 02:02:34,687 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for a66d8721ff7570b6cd367f8db32a9afb: 2023-10-01 02:02:34,689 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 02:02:34,689 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696125754689"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125754689"}]},"ts":"1696125754689"} 2023-10-01 02:02:34,690 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696125754689"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125754689"}]},"ts":"1696125754689"} 2023-10-01 02:02:34,691 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 02:02:34,692 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 02:02:34,692 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125754692"}]},"ts":"1696125754692"} 2023-10-01 02:02:34,693 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-10-01 02:02:34,695 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-10-01 02:02:34,696 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 02:02:34,696 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 02:02:34,696 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 02:02:34,696 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 02:02:34,696 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=ef837e043abef1a6c8661dc52b31ceab, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a66d8721ff7570b6cd367f8db32a9afb, ASSIGN}] 2023-10-01 02:02:34,699 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a66d8721ff7570b6cd367f8db32a9afb, ASSIGN 2023-10-01 02:02:34,699 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=ef837e043abef1a6c8661dc52b31ceab, ASSIGN 2023-10-01 02:02:34,699 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a66d8721ff7570b6cd367f8db32a9afb, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,43503,1696125669195; forceNewPlan=false, retain=false 2023-10-01 02:02:34,699 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=ef837e043abef1a6c8661dc52b31ceab, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,45065,1696125669145; forceNewPlan=false, retain=false 2023-10-01 02:02:34,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-01 02:02:34,850 INFO [jenkins-hbase17:37789] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 02:02:34,852 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=ef837e043abef1a6c8661dc52b31ceab, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:34,852 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=a66d8721ff7570b6cd367f8db32a9afb, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:34,852 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696125754852"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125754852"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125754852"}]},"ts":"1696125754852"} 2023-10-01 02:02:34,853 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696125754852"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125754852"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125754852"}]},"ts":"1696125754852"} 2023-10-01 02:02:34,854 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure a66d8721ff7570b6cd367f8db32a9afb, server=jenkins-hbase17.apache.org,43503,1696125669195}] 2023-10-01 02:02:34,854 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure ef837e043abef1a6c8661dc52b31ceab, server=jenkins-hbase17.apache.org,45065,1696125669145}] 2023-10-01 02:02:34,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-01 02:02:35,013 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab. 2023-10-01 02:02:35,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ef837e043abef1a6c8661dc52b31ceab, NAME => 'testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 02:02:35,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb. 2023-10-01 02:02:35,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab. service=AccessControlService 2023-10-01 02:02:35,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a66d8721ff7570b6cd367f8db32a9afb, NAME => 'testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 02:02:35,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 02:02:35,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb. service=AccessControlService 2023-10-01 02:02:35,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState ef837e043abef1a6c8661dc52b31ceab 2023-10-01 02:02:35,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:02:35,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 02:02:35,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for ef837e043abef1a6c8661dc52b31ceab 2023-10-01 02:02:35,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState a66d8721ff7570b6cd367f8db32a9afb 2023-10-01 02:02:35,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for ef837e043abef1a6c8661dc52b31ceab 2023-10-01 02:02:35,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:02:35,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for a66d8721ff7570b6cd367f8db32a9afb 2023-10-01 02:02:35,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for a66d8721ff7570b6cd367f8db32a9afb 2023-10-01 02:02:35,016 INFO [StoreOpener-a66d8721ff7570b6cd367f8db32a9afb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a66d8721ff7570b6cd367f8db32a9afb 2023-10-01 02:02:35,016 INFO [StoreOpener-ef837e043abef1a6c8661dc52b31ceab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ef837e043abef1a6c8661dc52b31ceab 2023-10-01 02:02:35,017 DEBUG [StoreOpener-a66d8721ff7570b6cd367f8db32a9afb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testEmptyExportFileSystemState/a66d8721ff7570b6cd367f8db32a9afb/cf 2023-10-01 02:02:35,017 DEBUG [StoreOpener-a66d8721ff7570b6cd367f8db32a9afb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testEmptyExportFileSystemState/a66d8721ff7570b6cd367f8db32a9afb/cf 2023-10-01 02:02:35,017 DEBUG [StoreOpener-ef837e043abef1a6c8661dc52b31ceab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testEmptyExportFileSystemState/ef837e043abef1a6c8661dc52b31ceab/cf 2023-10-01 02:02:35,017 DEBUG [StoreOpener-ef837e043abef1a6c8661dc52b31ceab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testEmptyExportFileSystemState/ef837e043abef1a6c8661dc52b31ceab/cf 2023-10-01 02:02:35,017 INFO [StoreOpener-a66d8721ff7570b6cd367f8db32a9afb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a66d8721ff7570b6cd367f8db32a9afb columnFamilyName cf 2023-10-01 02:02:35,017 INFO [StoreOpener-ef837e043abef1a6c8661dc52b31ceab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef837e043abef1a6c8661dc52b31ceab columnFamilyName cf 2023-10-01 02:02:35,019 INFO [StoreOpener-ef837e043abef1a6c8661dc52b31ceab-1] regionserver.HStore(310): Store=ef837e043abef1a6c8661dc52b31ceab/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 02:02:35,019 INFO [StoreOpener-a66d8721ff7570b6cd367f8db32a9afb-1] regionserver.HStore(310): Store=a66d8721ff7570b6cd367f8db32a9afb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 02:02:35,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testEmptyExportFileSystemState/ef837e043abef1a6c8661dc52b31ceab 2023-10-01 02:02:35,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testEmptyExportFileSystemState/a66d8721ff7570b6cd367f8db32a9afb 2023-10-01 02:02:35,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testEmptyExportFileSystemState/ef837e043abef1a6c8661dc52b31ceab 2023-10-01 02:02:35,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testEmptyExportFileSystemState/a66d8721ff7570b6cd367f8db32a9afb 2023-10-01 02:02:35,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for ef837e043abef1a6c8661dc52b31ceab 2023-10-01 02:02:35,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testEmptyExportFileSystemState/ef837e043abef1a6c8661dc52b31ceab/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 02:02:35,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for a66d8721ff7570b6cd367f8db32a9afb 2023-10-01 02:02:35,026 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened ef837e043abef1a6c8661dc52b31ceab; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58924910, jitterRate=-0.1219504177570343}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 02:02:35,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for ef837e043abef1a6c8661dc52b31ceab: 2023-10-01 02:02:35,026 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab., pid=94, masterSystemTime=1696125755005 2023-10-01 02:02:35,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testEmptyExportFileSystemState/a66d8721ff7570b6cd367f8db32a9afb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 02:02:35,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened a66d8721ff7570b6cd367f8db32a9afb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69253457, jitterRate=0.03195692598819733}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 02:02:35,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for a66d8721ff7570b6cd367f8db32a9afb: 2023-10-01 02:02:35,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab. 2023-10-01 02:02:35,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab. 2023-10-01 02:02:35,028 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=ef837e043abef1a6c8661dc52b31ceab, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb., pid=93, masterSystemTime=1696125755005 2023-10-01 02:02:35,028 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696125755028"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696125755028"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696125755028"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696125755028"}]},"ts":"1696125755028"} 2023-10-01 02:02:35,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb. 2023-10-01 02:02:35,030 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb. 2023-10-01 02:02:35,030 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=a66d8721ff7570b6cd367f8db32a9afb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,030 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696125755030"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696125755030"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696125755030"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696125755030"}]},"ts":"1696125755030"} 2023-10-01 02:02:35,031 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-10-01 02:02:35,031 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure ef837e043abef1a6c8661dc52b31ceab, server=jenkins-hbase17.apache.org,45065,1696125669145 in 176 msec 2023-10-01 02:02:35,032 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=ef837e043abef1a6c8661dc52b31ceab, ASSIGN in 335 msec 2023-10-01 02:02:35,032 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-10-01 02:02:35,032 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure a66d8721ff7570b6cd367f8db32a9afb, server=jenkins-hbase17.apache.org,43503,1696125669195 in 177 msec 2023-10-01 02:02:35,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-10-01 02:02:35,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a66d8721ff7570b6cd367f8db32a9afb, ASSIGN in 336 msec 2023-10-01 02:02:35,034 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 02:02:35,034 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125755034"}]},"ts":"1696125755034"} 2023-10-01 02:02:35,035 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-10-01 02:02:35,037 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 02:02:35,037 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-10-01 02:02:35,039 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45065] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 02:02:35,040 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:35,040 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:35,040 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:35,040 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:35,040 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 02:02:35,040 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 02:02:35,040 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 02:02:35,040 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 02:02:35,042 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 392 msec 2023-10-01 02:02:35,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-01 02:02:35,256 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-10-01 02:02:35,258 DEBUG [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-01 02:02:35,258 DEBUG [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab. 2023-10-01 02:02:35,259 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 02:02:35,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 02:02:35,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696125755272 (current time:1696125755272). 2023-10-01 02:02:35,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 02:02:35,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(139): Connect 0x58f93131 to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:02:35,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@355f21cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:02:35,282 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-01 02:02:35,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:02:35,284 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:37848, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:02:35,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58f93131 to 127.0.0.1:51733 2023-10-01 02:02:35,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:02:35,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(139): Connect 0x3b0d7a7a to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:02:35,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a6cb493, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:02:35,293 DEBUG [hconnection-0x6671a95a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:02:35,296 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:37850, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:02:35,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:02:35,304 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:35152, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:02:35,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b0d7a7a to 127.0.0.1:51733 2023-10-01 02:02:35,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:02:35,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 02:02:35,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 02:02:35,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 02:02:35,309 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot, current working dir path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 02:02:35,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 02:02:35,315 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 02:02:35,315 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696126355315 2023-10-01 02:02:35,315 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-01 02:02:35,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 02:02:35,317 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 02:02:35,317 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 02:02:35,318 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 02:02:35,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 02:02:35,319 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-10-01 02:02:35,322 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 02:02:35,323 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696126355323 2023-10-01 02:02:35,330 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,330 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-10-01 02:02:35,330 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:35,332 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-01 02:02:35,332 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-01 02:02:35,332 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,332 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,334 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:35,334 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,334 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:35,334 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:35,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:35,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:35,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:35,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:35,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:35,335 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:35,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,335 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,335 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,335 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-01 02:02:35,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-01 02:02:35,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,336 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 02:02:35,336 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 02:02:35,336 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,336 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,336 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 02:02:35,336 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 02:02:35,336 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:35,336 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:35,337 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 02:02:35,338 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 02:02:35,338 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44975,1696125669240' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 02:02:35,338 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 02:02:35,339 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 02:02:35,339 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,45065,1696125669145' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 02:02:35,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,339 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,339 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 02:02:35,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-01 02:02:35,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,339 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 02:02:35,339 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,339 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,340 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 02:02:35,340 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:35,340 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,341 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 02:02:35,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:35,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:35,341 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,341 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 02:02:35,341 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,43503,1696125669195' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 02:02:35,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:35,341 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,341 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:02:35,342 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,342 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:35,342 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,342 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:02:35,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:35,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:35,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,45065,1696125669145' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-01 02:02:35,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@345ab35[Count = 1] remaining members to acquire global barrier 2023-10-01 02:02:35,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:35,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:35,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:35,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:35,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:35,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:35,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,43503,1696125669195' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-01 02:02:35,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@345ab35[Count = 0] remaining members to acquire global barrier 2023-10-01 02:02:35,345 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-01 02:02:35,345 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,346 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,346 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,346 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,346 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 02:02:35,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,346 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 02:02:35,346 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,346 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,346 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 02:02:35,347 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 02:02:35,347 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 02:02:35,347 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 02:02:35,347 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab. 2023-10-01 02:02:35,347 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb. 2023-10-01 02:02:35,347 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab. started... 2023-10-01 02:02:35,347 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 02:02:35,347 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb. started... 2023-10-01 02:02:35,347 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ef837e043abef1a6c8661dc52b31ceab: 2023-10-01 02:02:35,348 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a66d8721ff7570b6cd367f8db32a9afb: 2023-10-01 02:02:35,348 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,348 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 02:02:35,348 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,348 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 02:02:35,348 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 02:02:35,348 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 02:02:35,349 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,349 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:02:35,349 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 02:02:35,349 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 02:02:35,349 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,44975,1696125669240' in zk 2023-10-01 02:02:35,350 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 02:02:35,350 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:35,350 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 02:02:35,360 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab. completed. 2023-10-01 02:02:35,360 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab. 2023-10-01 02:02:35,360 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 02:02:35,360 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 02:02:35,360 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,360 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 02:02:35,360 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,45065,1696125669145' in zk 2023-10-01 02:02:35,360 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb. completed. 2023-10-01 02:02:35,360 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb. 2023-10-01 02:02:35,360 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 02:02:35,360 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 02:02:35,361 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,361 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 02:02:35,361 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,43503,1696125669195' in zk 2023-10-01 02:02:35,361 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,361 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 02:02:35,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:35,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:35,361 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:35,361 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 02:02:35,363 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,363 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 02:02:35,363 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:35,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:35,363 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 02:02:35,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:35,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:35,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:35,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:35,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,45065,1696125669145': 2023-10-01 02:02:35,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,45065,1696125669145' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-01 02:02:35,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:35,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:35,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:35,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:35,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:35,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:35,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:35,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,43503,1696125669195': 2023-10-01 02:02:35,369 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,43503,1696125669195' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-01 02:02:35,369 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-10-01 02:02:35,369 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 02:02:35,369 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 02:02:35,369 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,369 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 02:02:35,371 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,371 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,371 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,371 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:35,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:35,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:35,371 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,371 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:35,371 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:35,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:35,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,371 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:35,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:35,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:35,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:35,371 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:35,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:35,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:35,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,372 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:35,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:35,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:35,373 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,373 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,374 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:35,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:35,375 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:35,376 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,376 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,376 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:35,376 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,376 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:35,376 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,376 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:35,376 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:35,376 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:35,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:35,376 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:35,376 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-01 02:02:35,376 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,376 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:35,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:35,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:35,376 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:35,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:35,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,376 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 02:02:35,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:35,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:35,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:35,376 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:35,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:35,378 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:35,378 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,378 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 02:02:35,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:35,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:35,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,415 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,416 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-01 02:02:35,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,416 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,417 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696125755316Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696125755391 (+75 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696125755391Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1696125755392 (+1 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1696125755399 (+7 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696125755411 (+12 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696125755416 (+5 ms) 2023-10-01 02:02:35,418 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 02:02:35,420 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 02:02:35,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 02:02:35,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 02:02:35,422 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 103 msec 2023-10-01 02:02:35,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45065] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 02:02:35,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43503] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 02:02:35,429 DEBUG [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-01 02:02:35,429 DEBUG [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab. 2023-10-01 02:02:35,430 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 02:02:35,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 02:02:35,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696125755442 (current time:1696125755442). 2023-10-01 02:02:35,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 02:02:35,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(139): Connect 0x3df2423f to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:02:35,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@338f7e49, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:02:35,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:02:35,451 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:37856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:02:35,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3df2423f to 127.0.0.1:51733 2023-10-01 02:02:35,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:02:35,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(139): Connect 0x5adcbe2a to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:02:35,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7590ecf4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:02:35,463 DEBUG [hconnection-0x3da5b939-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:02:35,464 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:37868, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:02:35,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:02:35,470 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:35160, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:02:35,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5adcbe2a to 127.0.0.1:51733 2023-10-01 02:02:35,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:02:35,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 02:02:35,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 02:02:35,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 02:02:35,474 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot, current working dir path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 02:02:35,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 02:02:35,477 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 02:02:35,478 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696126355478 2023-10-01 02:02:35,478 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-01 02:02:35,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 02:02:35,479 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 02:02:35,480 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 02:02:35,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 02:02:35,481 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 02:02:35,482 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-10-01 02:02:35,483 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 02:02:35,484 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696126355484 2023-10-01 02:02:35,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,497 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-10-01 02:02:35,497 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:35,498 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-01 02:02:35,498 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-01 02:02:35,499 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,499 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,499 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,500 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:35,500 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:35,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:35,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:35,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:35,500 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:35,500 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:35,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:35,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:35,500 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,500 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,500 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,500 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 02:02:35,500 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-01 02:02:35,501 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-01 02:02:35,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,501 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 02:02:35,501 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 02:02:35,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-01 02:02:35,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,501 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 02:02:35,502 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,502 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 02:02:35,502 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:35,503 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,505 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,505 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 02:02:35,505 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:35,505 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 02:02:35,506 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 02:02:35,506 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 02:02:35,506 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 02:02:35,506 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44975,1696125669240' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 02:02:35,505 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 02:02:35,506 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,43503,1696125669195' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 02:02:35,506 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:35,510 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 02:02:35,510 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 02:02:35,510 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,45065,1696125669145' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 02:02:35,511 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,513 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,513 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:35,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:35,513 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,513 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,513 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,513 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:02:35,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:35,513 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,513 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:02:35,513 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:35,513 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:02:35,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:35,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:35,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,43503,1696125669195' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-01 02:02:35,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@562e76c1[Count = 1] remaining members to acquire global barrier 2023-10-01 02:02:35,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:35,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:35,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:35,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:35,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:35,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:35,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,45065,1696125669145' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-01 02:02:35,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@562e76c1[Count = 0] remaining members to acquire global barrier 2023-10-01 02:02:35,516 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-01 02:02:35,516 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,517 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,517 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,517 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,517 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,517 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 02:02:35,517 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 02:02:35,518 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,518 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 02:02:35,518 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 02:02:35,518 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 02:02:35,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,518 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb. 2023-10-01 02:02:35,518 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 02:02:35,518 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 02:02:35,518 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,44975,1696125669240' in zk 2023-10-01 02:02:35,518 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 02:02:35,518 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 02:02:35,518 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb. started... 2023-10-01 02:02:35,518 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab. 2023-10-01 02:02:35,518 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab. started... 2023-10-01 02:02:35,518 INFO [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ef837e043abef1a6c8661dc52b31ceab 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-01 02:02:35,518 INFO [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a66d8721ff7570b6cd367f8db32a9afb 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-01 02:02:35,519 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 02:02:35,519 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:35,519 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 02:02:35,538 INFO [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231001d44bb4ffa3dc44c49fd855148e896275 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231001d44bb4ffa3dc44c49fd855148e896275 2023-10-01 02:02:35,538 INFO [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231001009578262d9f42148da43b335cd788c6 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231001009578262d9f42148da43b335cd788c6 2023-10-01 02:02:35,554 INFO [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testEmptyExportFileSystemState/a66d8721ff7570b6cd367f8db32a9afb/.tmp/cf/caa18a10c3c94b47872e6c8bf53c5f5b 2023-10-01 02:02:35,554 INFO [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testEmptyExportFileSystemState/ef837e043abef1a6c8661dc52b31ceab/.tmp/cf/ad9505147d164d3c8c82aaca8c34fd8c 2023-10-01 02:02:35,559 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testEmptyExportFileSystemState/a66d8721ff7570b6cd367f8db32a9afb/.tmp/cf/caa18a10c3c94b47872e6c8bf53c5f5b as hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testEmptyExportFileSystemState/a66d8721ff7570b6cd367f8db32a9afb/cf/caa18a10c3c94b47872e6c8bf53c5f5b 2023-10-01 02:02:35,559 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testEmptyExportFileSystemState/ef837e043abef1a6c8661dc52b31ceab/.tmp/cf/ad9505147d164d3c8c82aaca8c34fd8c as hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testEmptyExportFileSystemState/ef837e043abef1a6c8661dc52b31ceab/cf/ad9505147d164d3c8c82aaca8c34fd8c 2023-10-01 02:02:35,564 INFO [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testEmptyExportFileSystemState/ef837e043abef1a6c8661dc52b31ceab/cf/ad9505147d164d3c8c82aaca8c34fd8c, entries=3, sequenceid=6, filesize=5.4 K 2023-10-01 02:02:35,564 INFO [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testEmptyExportFileSystemState/a66d8721ff7570b6cd367f8db32a9afb/cf/caa18a10c3c94b47872e6c8bf53c5f5b, entries=47, sequenceid=6, filesize=13.1 K 2023-10-01 02:02:35,565 INFO [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for ef837e043abef1a6c8661dc52b31ceab in 47ms, sequenceid=6, compaction requested=false 2023-10-01 02:02:35,565 INFO [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for a66d8721ff7570b6cd367f8db32a9afb in 47ms, sequenceid=6, compaction requested=false 2023-10-01 02:02:35,566 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ef837e043abef1a6c8661dc52b31ceab: 2023-10-01 02:02:35,566 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a66d8721ff7570b6cd367f8db32a9afb: 2023-10-01 02:02:35,567 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,567 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,568 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 02:02:35,568 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 02:02:35,568 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testEmptyExportFileSystemState/ef837e043abef1a6c8661dc52b31ceab/cf/ad9505147d164d3c8c82aaca8c34fd8c] hfiles 2023-10-01 02:02:35,568 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testEmptyExportFileSystemState/a66d8721ff7570b6cd367f8db32a9afb/cf/caa18a10c3c94b47872e6c8bf53c5f5b] hfiles 2023-10-01 02:02:35,568 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testEmptyExportFileSystemState/a66d8721ff7570b6cd367f8db32a9afb/cf/caa18a10c3c94b47872e6c8bf53c5f5b for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,568 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testEmptyExportFileSystemState/ef837e043abef1a6c8661dc52b31ceab/cf/ad9505147d164d3c8c82aaca8c34fd8c for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,581 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 02:02:35,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 02:02:35,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-01 02:02:35,584 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 02:02:35,585 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab. completed. 2023-10-01 02:02:35,586 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab. 2023-10-01 02:02:35,586 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 02:02:35,586 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 02:02:35,586 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,586 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 02:02:35,586 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb. completed. 2023-10-01 02:02:35,586 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb. 2023-10-01 02:02:35,586 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,45065,1696125669145' in zk 2023-10-01 02:02:35,586 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 02:02:35,586 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 02:02:35,586 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,586 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 02:02:35,586 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,43503,1696125669195' in zk 2023-10-01 02:02:35,587 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,587 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 02:02:35,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:35,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:35,587 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:35,588 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 02:02:35,588 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,588 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 02:02:35,588 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:35,590 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 02:02:35,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:35,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:35,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:35,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:35,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:35,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,45065,1696125669145': 2023-10-01 02:02:35,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,45065,1696125669145' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-01 02:02:35,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:35,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:35,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:35,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:35,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:35,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,43503,1696125669195': 2023-10-01 02:02:35,596 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,43503,1696125669195' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-01 02:02:35,596 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-10-01 02:02:35,596 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 02:02:35,596 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 02:02:35,596 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,596 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 02:02:35,597 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,597 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,597 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,597 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:35,597 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:35,597 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:35,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:35,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,598 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:35,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,598 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:35,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:35,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:35,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:35,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:35,598 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:35,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:35,598 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:35,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:35,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:35,600 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:35,600 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,600 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:35,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:35,602 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:35,602 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,602 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:35,602 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:35,602 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:35,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:35,602 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:35,602 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:35,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:35,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:35,602 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:35,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:35,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:35,602 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,602 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:35,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:35,602 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:35,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:35,602 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-01 02:02:35,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:35,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:35,604 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:35,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:35,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 02:02:35,604 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,604 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:35,604 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,604 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:35,604 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:35,604 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,604 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231001d44bb4ffa3dc44c49fd855148e896275, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231001009578262d9f42148da43b335cd788c6] mob files 2023-10-01 02:02:35,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231001d44bb4ffa3dc44c49fd855148e896275 2023-10-01 02:02:35,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231001009578262d9f42148da43b335cd788c6 2023-10-01 02:02:35,613 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,634 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-01 02:02:35,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,635 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696125755478Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696125755613 (+135 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1696125755613Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1696125755613Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1696125755616 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1696125755626 (+10 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696125755634 (+8 ms) 2023-10-01 02:02:35,640 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 02:02:35,642 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 162 msec 2023-10-01 02:02:35,785 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 02:02:35,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 02:02:35,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 02:02:35,786 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125755786 2023-10-01 02:02:35,786 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33385, tgtDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125755786, rawTgtDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125755786, srcFsUri=hdfs://localhost:33385, srcDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae 2023-10-01 02:02:35,809 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33385, inputRoot=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae 2023-10-01 02:02:35,809 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_990047603_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125755786, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125755786/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,809 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33385, inputRoot=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae, snapshotDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-10-01 02:02:35,815 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125755786/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:35,836 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:35,837 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:35,837 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:35,838 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:36,560 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/hadoop-2627350309046892762.jar 2023-10-01 02:02:36,560 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:36,561 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:36,615 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/hadoop-7434923887864698100.jar 2023-10-01 02:02:36,616 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:36,616 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:36,616 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:36,617 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:36,617 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:36,617 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:36,618 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 02:02:36,618 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 02:02:36,618 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 02:02:36,618 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 02:02:36,619 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 02:02:36,619 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 02:02:36,619 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 02:02:36,620 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 02:02:36,620 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 02:02:36,620 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 02:02:36,621 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:02:36,621 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:02:36,622 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 02:02:36,622 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:02:36,622 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:02:36,623 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 02:02:36,624 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 02:02:37,370 WARN [Listener at jenkins-hbase17.apache.org/41447] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 02:02:37,372 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-10-01 02:02:38,490 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 02:02:38,490 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 02:02:38,493 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0005_000001 (auth:SIMPLE) 2023-10-01 02:02:38,671 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0006_000001 (auth:SIMPLE) 2023-10-01 02:02:39,498 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 02:02:42,156 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0006_000001 (auth:SIMPLE) 2023-10-01 02:02:44,719 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 02:02:44,720 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 02:02:44,725 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:44,726 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 02:02:44,726 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 02:02:44,726 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-403693088_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:44,727 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-01 02:02:44,727 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-01 02:02:44,727 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-403693088_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125755786/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125755786/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:44,728 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125755786/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-01 02:02:44,728 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125755786/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-01 02:02:44,733 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-10-01 02:02:44,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testEmptyExportFileSystemState 2023-10-01 02:02:44,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 02:02:44,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-01 02:02:44,737 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125764737"}]},"ts":"1696125764737"} 2023-10-01 02:02:44,738 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-10-01 02:02:44,750 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-10-01 02:02:44,751 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=ef837e043abef1a6c8661dc52b31ceab, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a66d8721ff7570b6cd367f8db32a9afb, UNASSIGN}] 2023-10-01 02:02:44,753 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=ef837e043abef1a6c8661dc52b31ceab, UNASSIGN 2023-10-01 02:02:44,753 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a66d8721ff7570b6cd367f8db32a9afb, UNASSIGN 2023-10-01 02:02:44,754 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=a66d8721ff7570b6cd367f8db32a9afb, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:44,754 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=ef837e043abef1a6c8661dc52b31ceab, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:44,754 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696125764754"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125764754"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125764754"}]},"ts":"1696125764754"} 2023-10-01 02:02:44,754 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696125764754"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125764754"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125764754"}]},"ts":"1696125764754"} 2023-10-01 02:02:44,755 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure a66d8721ff7570b6cd367f8db32a9afb, server=jenkins-hbase17.apache.org,43503,1696125669195}] 2023-10-01 02:02:44,756 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure ef837e043abef1a6c8661dc52b31ceab, server=jenkins-hbase17.apache.org,45065,1696125669145}] 2023-10-01 02:02:44,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-01 02:02:44,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close a66d8721ff7570b6cd367f8db32a9afb 2023-10-01 02:02:44,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing a66d8721ff7570b6cd367f8db32a9afb, disabling compactions & flushes 2023-10-01 02:02:44,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb. 2023-10-01 02:02:44,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb. 2023-10-01 02:02:44,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb. after waiting 0 ms 2023-10-01 02:02:44,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb. 2023-10-01 02:02:44,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close ef837e043abef1a6c8661dc52b31ceab 2023-10-01 02:02:44,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing ef837e043abef1a6c8661dc52b31ceab, disabling compactions & flushes 2023-10-01 02:02:44,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab. 2023-10-01 02:02:44,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab. 2023-10-01 02:02:44,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab. after waiting 0 ms 2023-10-01 02:02:44,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab. 2023-10-01 02:02:44,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testEmptyExportFileSystemState/a66d8721ff7570b6cd367f8db32a9afb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 02:02:44,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testEmptyExportFileSystemState/ef837e043abef1a6c8661dc52b31ceab/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 02:02:44,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 02:02:44,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb. 2023-10-01 02:02:44,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for a66d8721ff7570b6cd367f8db32a9afb: 2023-10-01 02:02:44,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 02:02:44,921 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab. 2023-10-01 02:02:44,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for ef837e043abef1a6c8661dc52b31ceab: 2023-10-01 02:02:44,922 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed a66d8721ff7570b6cd367f8db32a9afb 2023-10-01 02:02:44,923 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=a66d8721ff7570b6cd367f8db32a9afb, regionState=CLOSED 2023-10-01 02:02:44,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed ef837e043abef1a6c8661dc52b31ceab 2023-10-01 02:02:44,923 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696125764923"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125764923"}]},"ts":"1696125764923"} 2023-10-01 02:02:44,923 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=ef837e043abef1a6c8661dc52b31ceab, regionState=CLOSED 2023-10-01 02:02:44,923 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696125764923"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125764923"}]},"ts":"1696125764923"} 2023-10-01 02:02:44,928 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=100 2023-10-01 02:02:44,928 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=101 2023-10-01 02:02:44,928 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure ef837e043abef1a6c8661dc52b31ceab, server=jenkins-hbase17.apache.org,45065,1696125669145 in 169 msec 2023-10-01 02:02:44,928 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure a66d8721ff7570b6cd367f8db32a9afb, server=jenkins-hbase17.apache.org,43503,1696125669195 in 169 msec 2023-10-01 02:02:44,929 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=ef837e043abef1a6c8661dc52b31ceab, UNASSIGN in 177 msec 2023-10-01 02:02:44,929 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-10-01 02:02:44,929 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a66d8721ff7570b6cd367f8db32a9afb, UNASSIGN in 177 msec 2023-10-01 02:02:44,929 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125764929"}]},"ts":"1696125764929"} 2023-10-01 02:02:44,930 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-10-01 02:02:44,993 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-10-01 02:02:44,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 261 msec 2023-10-01 02:02:45,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-01 02:02:45,039 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-10-01 02:02:45,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testEmptyExportFileSystemState 2023-10-01 02:02:45,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 02:02:45,043 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 02:02:45,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-10-01 02:02:45,043 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 02:02:45,045 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45065] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-10-01 02:02:45,047 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/ef837e043abef1a6c8661dc52b31ceab 2023-10-01 02:02:45,047 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/a66d8721ff7570b6cd367f8db32a9afb 2023-10-01 02:02:45,048 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/ef837e043abef1a6c8661dc52b31ceab/cf, FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/ef837e043abef1a6c8661dc52b31ceab/recovered.edits] 2023-10-01 02:02:45,048 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/a66d8721ff7570b6cd367f8db32a9afb/cf, FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/a66d8721ff7570b6cd367f8db32a9afb/recovered.edits] 2023-10-01 02:02:45,052 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/ef837e043abef1a6c8661dc52b31ceab/cf/ad9505147d164d3c8c82aaca8c34fd8c to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testEmptyExportFileSystemState/ef837e043abef1a6c8661dc52b31ceab/cf/ad9505147d164d3c8c82aaca8c34fd8c 2023-10-01 02:02:45,052 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/a66d8721ff7570b6cd367f8db32a9afb/cf/caa18a10c3c94b47872e6c8bf53c5f5b to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testEmptyExportFileSystemState/a66d8721ff7570b6cd367f8db32a9afb/cf/caa18a10c3c94b47872e6c8bf53c5f5b 2023-10-01 02:02:45,054 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/ef837e043abef1a6c8661dc52b31ceab/recovered.edits/9.seqid to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testEmptyExportFileSystemState/ef837e043abef1a6c8661dc52b31ceab/recovered.edits/9.seqid 2023-10-01 02:02:45,054 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/a66d8721ff7570b6cd367f8db32a9afb/recovered.edits/9.seqid to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testEmptyExportFileSystemState/a66d8721ff7570b6cd367f8db32a9afb/recovered.edits/9.seqid 2023-10-01 02:02:45,054 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/ef837e043abef1a6c8661dc52b31ceab 2023-10-01 02:02:45,055 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testEmptyExportFileSystemState/a66d8721ff7570b6cd367f8db32a9afb 2023-10-01 02:02:45,055 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-01 02:02:45,055 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-01 02:02:45,056 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-10-01 02:02:45,058 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231001d44bb4ffa3dc44c49fd855148e896275 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231001d44bb4ffa3dc44c49fd855148e896275 2023-10-01 02:02:45,059 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231001009578262d9f42148da43b335cd788c6 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231001009578262d9f42148da43b335cd788c6 2023-10-01 02:02:45,059 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-01 02:02:45,061 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 02:02:45,063 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-10-01 02:02:45,064 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-10-01 02:02:45,065 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 02:02:45,065 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-10-01 02:02:45,066 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696125765065"}]},"ts":"9223372036854775807"} 2023-10-01 02:02:45,066 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696125765065"}]},"ts":"9223372036854775807"} 2023-10-01 02:02:45,067 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 02:02:45,067 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ef837e043abef1a6c8661dc52b31ceab, NAME => 'testtb-testEmptyExportFileSystemState,,1696125754648.ef837e043abef1a6c8661dc52b31ceab.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a66d8721ff7570b6cd367f8db32a9afb, NAME => 'testtb-testEmptyExportFileSystemState,1,1696125754648.a66d8721ff7570b6cd367f8db32a9afb.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 02:02:45,068 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-10-01 02:02:45,068 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696125765068"}]},"ts":"9223372036854775807"} 2023-10-01 02:02:45,069 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 02:02:45,069 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 02:02:45,069 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 02:02:45,069 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-10-01 02:02:45,069 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 02:02:45,069 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-01 02:02:45,069 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-01 02:02:45,069 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-01 02:02:45,070 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-01 02:02:45,070 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 02:02:45,070 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 02:02:45,070 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:45,070 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:45,070 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 02:02:45,071 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:45,071 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 02:02:45,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-01 02:02:45,072 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 02:02:45,072 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:45,075 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 31 msec 2023-10-01 02:02:45,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-01 02:02:45,173 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-10-01 02:02:45,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-10-01 02:02:45,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:45,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-10-01 02:02:45,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-10-01 02:02:45,207 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 762) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-18373272_1 at /127.0.0.1:36870 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74c15b32-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1111612899) connection to jenkins-hbase17.apache.org/136.243.18.41:34047 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-4610 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1111612899) connection to jenkins-hbase17.apache.org/136.243.18.41:41299 from appattempt_1696125675850_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-403693088_17 at /127.0.0.1:44330 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74c15b32-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-18373272_1 at /127.0.0.1:44314 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74c15b32-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1111612899) connection to jenkins-hbase17.apache.org/136.243.18.41:34583 from appattempt_1696125675850_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-403693088_17 at /127.0.0.1:41988 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74c15b32-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-403693088_17 at /127.0.0.1:36946 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=949 (was 917) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=260 (was 263), ProcessCount=179 (was 179), AvailableMemoryMB=8338 (was 8550) 2023-10-01 02:02:45,208 WARN [Listener at jenkins-hbase17.apache.org/41447] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-01 02:02:45,226 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=949, MaxFileDescriptor=60000, SystemLoadAverage=260, ProcessCount=179, AvailableMemoryMB=8338 2023-10-01 02:02:45,227 WARN [Listener at jenkins-hbase17.apache.org/41447] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-01 02:02:45,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 02:02:45,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,231 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 02:02:45,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-10-01 02:02:45,232 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 02:02:45,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-01 02:02:45,234 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/50782faa36789627f8c0ae0ce9f1a845 2023-10-01 02:02:45,234 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3181aefe88f68f128e777e32ca5882e 2023-10-01 02:02:45,234 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/50782faa36789627f8c0ae0ce9f1a845 empty. 2023-10-01 02:02:45,234 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3181aefe88f68f128e777e32ca5882e empty. 2023-10-01 02:02:45,235 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/50782faa36789627f8c0ae0ce9f1a845 2023-10-01 02:02:45,235 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3181aefe88f68f128e777e32ca5882e 2023-10-01 02:02:45,235 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-01 02:02:45,252 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-10-01 02:02:45,253 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => b3181aefe88f68f128e777e32ca5882e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp 2023-10-01 02:02:45,253 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 50782faa36789627f8c0ae0ce9f1a845, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp 2023-10-01 02:02:45,277 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:02:45,277 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing b3181aefe88f68f128e777e32ca5882e, disabling compactions & flushes 2023-10-01 02:02:45,277 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e. 2023-10-01 02:02:45,277 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e. 2023-10-01 02:02:45,277 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:02:45,277 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e. after waiting 0 ms 2023-10-01 02:02:45,278 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e. 2023-10-01 02:02:45,278 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 50782faa36789627f8c0ae0ce9f1a845, disabling compactions & flushes 2023-10-01 02:02:45,278 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e. 2023-10-01 02:02:45,278 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for b3181aefe88f68f128e777e32ca5882e: 2023-10-01 02:02:45,278 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845. 2023-10-01 02:02:45,278 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845. 2023-10-01 02:02:45,278 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845. after waiting 0 ms 2023-10-01 02:02:45,278 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845. 2023-10-01 02:02:45,278 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845. 2023-10-01 02:02:45,278 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 50782faa36789627f8c0ae0ce9f1a845: 2023-10-01 02:02:45,280 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 02:02:45,281 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696125765280"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125765280"}]},"ts":"1696125765280"} 2023-10-01 02:02:45,281 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696125765280"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125765280"}]},"ts":"1696125765280"} 2023-10-01 02:02:45,283 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 02:02:45,284 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 02:02:45,284 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125765284"}]},"ts":"1696125765284"} 2023-10-01 02:02:45,285 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-10-01 02:02:45,287 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-10-01 02:02:45,288 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 02:02:45,288 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 02:02:45,288 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 02:02:45,288 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 02:02:45,288 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=50782faa36789627f8c0ae0ce9f1a845, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b3181aefe88f68f128e777e32ca5882e, ASSIGN}] 2023-10-01 02:02:45,291 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=50782faa36789627f8c0ae0ce9f1a845, ASSIGN 2023-10-01 02:02:45,291 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b3181aefe88f68f128e777e32ca5882e, ASSIGN 2023-10-01 02:02:45,292 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=50782faa36789627f8c0ae0ce9f1a845, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,43503,1696125669195; forceNewPlan=false, retain=false 2023-10-01 02:02:45,292 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b3181aefe88f68f128e777e32ca5882e, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,45065,1696125669145; forceNewPlan=false, retain=false 2023-10-01 02:02:45,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-01 02:02:45,442 INFO [jenkins-hbase17:37789] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 02:02:45,445 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=b3181aefe88f68f128e777e32ca5882e, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:45,445 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=50782faa36789627f8c0ae0ce9f1a845, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:45,445 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696125765445"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125765445"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125765445"}]},"ts":"1696125765445"} 2023-10-01 02:02:45,445 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696125765445"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125765445"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125765445"}]},"ts":"1696125765445"} 2023-10-01 02:02:45,446 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure b3181aefe88f68f128e777e32ca5882e, server=jenkins-hbase17.apache.org,45065,1696125669145}] 2023-10-01 02:02:45,447 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 50782faa36789627f8c0ae0ce9f1a845, server=jenkins-hbase17.apache.org,43503,1696125669195}] 2023-10-01 02:02:45,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-01 02:02:45,601 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e. 2023-10-01 02:02:45,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b3181aefe88f68f128e777e32ca5882e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 02:02:45,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e. service=AccessControlService 2023-10-01 02:02:45,601 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 02:02:45,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp b3181aefe88f68f128e777e32ca5882e 2023-10-01 02:02:45,602 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845. 2023-10-01 02:02:45,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:02:45,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for b3181aefe88f68f128e777e32ca5882e 2023-10-01 02:02:45,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 50782faa36789627f8c0ae0ce9f1a845, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 02:02:45,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for b3181aefe88f68f128e777e32ca5882e 2023-10-01 02:02:45,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845. service=AccessControlService 2023-10-01 02:02:45,602 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 02:02:45,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 50782faa36789627f8c0ae0ce9f1a845 2023-10-01 02:02:45,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 02:02:45,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 50782faa36789627f8c0ae0ce9f1a845 2023-10-01 02:02:45,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 50782faa36789627f8c0ae0ce9f1a845 2023-10-01 02:02:45,603 INFO [StoreOpener-b3181aefe88f68f128e777e32ca5882e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b3181aefe88f68f128e777e32ca5882e 2023-10-01 02:02:45,604 INFO [StoreOpener-50782faa36789627f8c0ae0ce9f1a845-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 50782faa36789627f8c0ae0ce9f1a845 2023-10-01 02:02:45,604 DEBUG [StoreOpener-b3181aefe88f68f128e777e32ca5882e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3181aefe88f68f128e777e32ca5882e/cf 2023-10-01 02:02:45,604 DEBUG [StoreOpener-b3181aefe88f68f128e777e32ca5882e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3181aefe88f68f128e777e32ca5882e/cf 2023-10-01 02:02:45,605 INFO [StoreOpener-b3181aefe88f68f128e777e32ca5882e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b3181aefe88f68f128e777e32ca5882e columnFamilyName cf 2023-10-01 02:02:45,605 DEBUG [StoreOpener-50782faa36789627f8c0ae0ce9f1a845-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/50782faa36789627f8c0ae0ce9f1a845/cf 2023-10-01 02:02:45,605 DEBUG [StoreOpener-50782faa36789627f8c0ae0ce9f1a845-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/50782faa36789627f8c0ae0ce9f1a845/cf 2023-10-01 02:02:45,605 INFO [StoreOpener-50782faa36789627f8c0ae0ce9f1a845-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 50782faa36789627f8c0ae0ce9f1a845 columnFamilyName cf 2023-10-01 02:02:45,606 INFO [StoreOpener-b3181aefe88f68f128e777e32ca5882e-1] regionserver.HStore(310): Store=b3181aefe88f68f128e777e32ca5882e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 02:02:45,606 INFO [StoreOpener-50782faa36789627f8c0ae0ce9f1a845-1] regionserver.HStore(310): Store=50782faa36789627f8c0ae0ce9f1a845/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 02:02:45,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3181aefe88f68f128e777e32ca5882e 2023-10-01 02:02:45,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/50782faa36789627f8c0ae0ce9f1a845 2023-10-01 02:02:45,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3181aefe88f68f128e777e32ca5882e 2023-10-01 02:02:45,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/50782faa36789627f8c0ae0ce9f1a845 2023-10-01 02:02:45,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 50782faa36789627f8c0ae0ce9f1a845 2023-10-01 02:02:45,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for b3181aefe88f68f128e777e32ca5882e 2023-10-01 02:02:45,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3181aefe88f68f128e777e32ca5882e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 02:02:45,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened b3181aefe88f68f128e777e32ca5882e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64215496, jitterRate=-0.043114542961120605}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 02:02:45,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for b3181aefe88f68f128e777e32ca5882e: 2023-10-01 02:02:45,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/50782faa36789627f8c0ae0ce9f1a845/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 02:02:45,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e., pid=108, masterSystemTime=1696125765598 2023-10-01 02:02:45,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 50782faa36789627f8c0ae0ce9f1a845; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70140016, jitterRate=0.04516768455505371}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 02:02:45,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 50782faa36789627f8c0ae0ce9f1a845: 2023-10-01 02:02:45,617 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845., pid=109, masterSystemTime=1696125765598 2023-10-01 02:02:45,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e. 2023-10-01 02:02:45,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e. 2023-10-01 02:02:45,618 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=b3181aefe88f68f128e777e32ca5882e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:45,619 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696125765618"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696125765618"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696125765618"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696125765618"}]},"ts":"1696125765618"} 2023-10-01 02:02:45,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845. 2023-10-01 02:02:45,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845. 2023-10-01 02:02:45,620 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=50782faa36789627f8c0ae0ce9f1a845, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:45,621 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696125765620"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696125765620"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696125765620"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696125765620"}]},"ts":"1696125765620"} 2023-10-01 02:02:45,622 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-10-01 02:02:45,622 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure b3181aefe88f68f128e777e32ca5882e, server=jenkins-hbase17.apache.org,45065,1696125669145 in 174 msec 2023-10-01 02:02:45,623 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b3181aefe88f68f128e777e32ca5882e, ASSIGN in 334 msec 2023-10-01 02:02:45,623 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-10-01 02:02:45,623 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 50782faa36789627f8c0ae0ce9f1a845, server=jenkins-hbase17.apache.org,43503,1696125669195 in 175 msec 2023-10-01 02:02:45,624 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-10-01 02:02:45,625 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=50782faa36789627f8c0ae0ce9f1a845, ASSIGN in 335 msec 2023-10-01 02:02:45,625 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 02:02:45,625 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125765625"}]},"ts":"1696125765625"} 2023-10-01 02:02:45,626 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-10-01 02:02:45,628 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 02:02:45,628 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-10-01 02:02:45,630 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45065] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-01 02:02:45,631 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:45,631 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:45,631 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:45,631 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:45,632 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-01 02:02:45,632 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-01 02:02:45,632 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-01 02:02:45,633 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-01 02:02:45,634 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 404 msec 2023-10-01 02:02:45,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-01 02:02:45,836 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-10-01 02:02:45,838 DEBUG [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,838 DEBUG [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845. 2023-10-01 02:02:45,839 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 02:02:45,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 02:02:45,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696125765850 (current time:1696125765850). 2023-10-01 02:02:45,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 02:02:45,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(139): Connect 0x773cc3c7 to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:02:45,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5072015f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:02:45,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:02:45,864 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42098, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:02:45,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x773cc3c7 to 127.0.0.1:51733 2023-10-01 02:02:45,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:02:45,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(139): Connect 0x2f9ffb31 to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:02:45,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3eac37fe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:02:45,874 DEBUG [hconnection-0x7e94a18d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:02:45,877 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42100, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:02:45,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:02:45,884 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:02:45,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f9ffb31 to 127.0.0.1:51733 2023-10-01 02:02:45,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:02:45,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-01 02:02:45,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 02:02:45,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 02:02:45,889 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot, current working dir path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 02:02:45,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 02:02:45,892 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 02:02:45,893 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696126365893 2023-10-01 02:02:45,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 02:02:45,893 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,896 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 02:02:45,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 02:02:45,896 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 02:02:45,896 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 02:02:45,897 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-10-01 02:02:45,898 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 02:02:45,899 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696126365899 2023-10-01 02:02:45,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,913 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-01 02:02:45,913 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:45,914 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-01 02:02:45,914 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-01 02:02:45,914 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,914 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,916 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:45,916 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:45,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:45,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:45,916 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:45,916 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:45,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:45,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:45,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:45,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:45,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,917 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:45,917 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:45,917 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,917 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,917 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,917 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:45,917 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 02:02:45,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-01 02:02:45,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-01 02:02:45,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-01 02:02:45,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,918 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 02:02:45,918 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 02:02:45,918 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 02:02:45,918 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,918 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,918 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,918 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 02:02:45,918 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 02:02:45,918 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:45,918 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:45,918 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 02:02:45,920 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 02:02:45,919 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 02:02:45,920 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 02:02:45,920 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 02:02:45,920 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:45,920 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,45065,1696125669145' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 02:02:45,921 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 02:02:45,921 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 02:02:45,921 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44975,1696125669240' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 02:02:45,920 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,43503,1696125669195' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 02:02:45,922 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,922 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:45,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:45,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:45,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:45,923 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,923 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:02:45,923 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:45,923 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,923 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:45,923 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,923 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:45,923 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:02:45,923 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:02:45,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:45,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:45,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:45,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:45,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,45065,1696125669145' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-01 02:02:45,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@da2b3c[Count = 1] remaining members to acquire global barrier 2023-10-01 02:02:45,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:45,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:45,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:45,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:45,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:45,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:45,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:45,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:45,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:45,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,43503,1696125669195' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-01 02:02:45,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@da2b3c[Count = 0] remaining members to acquire global barrier 2023-10-01 02:02:45,926 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-01 02:02:45,926 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,926 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,926 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,926 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,926 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:45,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,927 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 02:02:45,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,927 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 02:02:45,927 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:45,927 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 02:02:45,927 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 02:02:45,927 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e. 2023-10-01 02:02:45,927 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 02:02:45,927 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 02:02:45,927 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 02:02:45,927 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845. 2023-10-01 02:02:45,927 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 02:02:45,927 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 02:02:45,927 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e. started... 2023-10-01 02:02:45,927 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845. started... 2023-10-01 02:02:45,927 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,44975,1696125669240' in zk 2023-10-01 02:02:45,929 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b3181aefe88f68f128e777e32ca5882e: 2023-10-01 02:02:45,929 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 50782faa36789627f8c0ae0ce9f1a845: 2023-10-01 02:02:45,929 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,929 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,929 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 02:02:45,929 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 02:02:45,929 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 02:02:45,929 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 02:02:45,930 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 02:02:45,930 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:45,930 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 02:02:45,945 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845. completed. 2023-10-01 02:02:45,945 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845. 2023-10-01 02:02:45,945 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 02:02:45,945 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 02:02:45,945 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:45,945 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 02:02:45,945 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,43503,1696125669195' in zk 2023-10-01 02:02:45,946 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:45,946 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 02:02:45,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:45,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:45,946 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:45,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:45,947 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 02:02:45,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:45,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:45,949 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e. completed. 2023-10-01 02:02:45,949 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e. 2023-10-01 02:02:45,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,949 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 02:02:45,949 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 02:02:45,949 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:45,949 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 02:02:45,949 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,45065,1696125669145' in zk 2023-10-01 02:02:45,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:45,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:45,950 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 02:02:45,950 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:45,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:45,950 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:45,950 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 02:02:45,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:45,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:45,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:45,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:45,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,43503,1696125669195': 2023-10-01 02:02:45,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,43503,1696125669195' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-01 02:02:45,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:45,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:45,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:45,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:45,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:45,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:45,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:45,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:45,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:45,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:45,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:45,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:45,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,45065,1696125669145': 2023-10-01 02:02:45,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,45065,1696125669145' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-01 02:02:45,956 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-01 02:02:45,956 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 02:02:45,956 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 02:02:45,956 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,956 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 02:02:45,957 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,957 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,957 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:45,957 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,957 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,957 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:45,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,958 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:45,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:45,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:45,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:45,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:45,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:45,958 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:45,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:45,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:45,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:45,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:45,959 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:45,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,959 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:45,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:45,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:45,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:45,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:45,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:45,960 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:45,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,960 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:45,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:45,961 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:45,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:45,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:45,962 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:45,963 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,963 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:45,963 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:45,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:45,963 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:45,963 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:45,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:45,963 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:45,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:45,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:45,963 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:45,963 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:45,963 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,963 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:45,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:45,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:45,963 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:45,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:45,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:45,963 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,963 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:45,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:45,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:45,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,965 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:45,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 02:02:45,965 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:45,965 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:45,965 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:45,965 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,965 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 02:02:45,973 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,973 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,987 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,988 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-01 02:02:45,988 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,988 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:45,988 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696125765893Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696125765973 (+80 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696125765973Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696125765973Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696125765976 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696125765982 (+6 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696125765988 (+6 ms) 2023-10-01 02:02:45,990 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 02:02:45,991 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 96 msec 2023-10-01 02:02:45,997 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 02:02:45,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-01 02:02:45,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 02:02:46,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43503] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 02:02:46,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45065] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 02:02:46,002 DEBUG [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,002 DEBUG [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845. 2023-10-01 02:02:46,003 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 02:02:46,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 02:02:46,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696125766011 (current time:1696125766011). 2023-10-01 02:02:46,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 02:02:46,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(139): Connect 0x254d534d to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:02:46,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14abf1fb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:02:46,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:02:46,019 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42106, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:02:46,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x254d534d to 127.0.0.1:51733 2023-10-01 02:02:46,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:02:46,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(139): Connect 0x550d6301 to 127.0.0.1:51733 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 02:02:46,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a1585d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 02:02:46,028 DEBUG [hconnection-0x517a9b46-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:02:46,031 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42120, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:02:46,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 02:02:46,039 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 02:02:46,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x550d6301 to 127.0.0.1:51733 2023-10-01 02:02:46,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:02:46,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-01 02:02:46,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 02:02:46,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 02:02:46,044 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot, current working dir path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 02:02:46,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 02:02:46,046 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 02:02:46,047 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696126366047 2023-10-01 02:02:46,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 02:02:46,047 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,048 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 02:02:46,048 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 02:02:46,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 02:02:46,050 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 02:02:46,051 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-10-01 02:02:46,052 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 02:02:46,052 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696126366052 2023-10-01 02:02:46,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,065 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-01 02:02:46,065 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:46,066 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-01 02:02:46,066 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-01 02:02:46,067 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,067 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,069 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:46,069 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:46,069 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:46,069 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:46,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:46,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:46,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:46,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:46,069 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:46,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:46,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:46,069 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:46,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,069 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:46,070 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 02:02:46,070 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,070 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,070 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-01 02:02:46,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-01 02:02:46,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-01 02:02:46,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,070 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 02:02:46,070 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 02:02:46,070 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 02:02:46,073 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,073 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 02:02:46,073 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:46,075 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,076 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,076 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 02:02:46,077 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:46,076 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 02:02:46,078 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 02:02:46,078 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 02:02:46,078 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 02:02:46,078 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44975,1696125669240' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 02:02:46,077 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 02:02:46,078 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 02:02:46,078 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,45065,1696125669145' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 02:02:46,079 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 02:02:46,079 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 02:02:46,079 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,43503,1696125669195' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 02:02:46,080 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,082 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:46,082 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:46,082 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,082 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:02:46,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:46,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:46,082 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,082 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:46,082 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,083 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:02:46,083 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,083 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 02:02:46,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:46,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:46,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:46,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:46,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:46,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:46,084 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,45065,1696125669145' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-01 02:02:46,084 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60170a78[Count = 1] remaining members to acquire global barrier 2023-10-01 02:02:46,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:46,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:46,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:46,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:46,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:46,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:46,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:46,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:46,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:46,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,43503,1696125669195' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-01 02:02:46,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60170a78[Count = 0] remaining members to acquire global barrier 2023-10-01 02:02:46,086 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-01 02:02:46,086 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,086 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,086 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,086 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,087 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 02:02:46,087 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:46,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,087 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 02:02:46,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,087 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 02:02:46,087 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 02:02:46,087 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e. 2023-10-01 02:02:46,087 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 02:02:46,087 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 02:02:46,087 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 02:02:46,087 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 02:02:46,087 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,44975,1696125669240' in zk 2023-10-01 02:02:46,087 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:46,087 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 02:02:46,087 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845. 2023-10-01 02:02:46,087 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e. started... 2023-10-01 02:02:46,087 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845. started... 2023-10-01 02:02:46,087 INFO [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b3181aefe88f68f128e777e32ca5882e 1/1 column families, dataSize=2.67 KB heapSize=6.02 KB 2023-10-01 02:02:46,087 INFO [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 50782faa36789627f8c0ae0ce9f1a845 1/1 column families, dataSize=601 B heapSize=1.52 KB 2023-10-01 02:02:46,089 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 02:02:46,089 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:46,089 DEBUG [member: 'jenkins-hbase17.apache.org,44975,1696125669240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 02:02:46,120 INFO [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231001fd0457754c7d488298280e80b1b58435 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20231001fd0457754c7d488298280e80b1b58435 2023-10-01 02:02:46,121 INFO [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231001c1c41e53f8e940dd818338ddc4e3b286 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231001c1c41e53f8e940dd818338ddc4e3b286 2023-10-01 02:02:46,141 INFO [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.7 K, hasBloomFilter=true, into tmp file hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3181aefe88f68f128e777e32ca5882e/.tmp/cf/af260c2f13b34c59a121ea18d6c5b821 2023-10-01 02:02:46,142 INFO [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=601, hasBloomFilter=true, into tmp file hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/50782faa36789627f8c0ae0ce9f1a845/.tmp/cf/7fdb378f193c49b7ad54052b481accd9 2023-10-01 02:02:46,145 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3181aefe88f68f128e777e32ca5882e/.tmp/cf/af260c2f13b34c59a121ea18d6c5b821 as hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3181aefe88f68f128e777e32ca5882e/cf/af260c2f13b34c59a121ea18d6c5b821 2023-10-01 02:02:46,146 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/50782faa36789627f8c0ae0ce9f1a845/.tmp/cf/7fdb378f193c49b7ad54052b481accd9 as hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/50782faa36789627f8c0ae0ce9f1a845/cf/7fdb378f193c49b7ad54052b481accd9 2023-10-01 02:02:46,148 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 02:02:46,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-01 02:02:46,150 INFO [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3181aefe88f68f128e777e32ca5882e/cf/af260c2f13b34c59a121ea18d6c5b821, entries=41, sequenceid=6, filesize=12.3 K 2023-10-01 02:02:46,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-01 02:02:46,150 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 02:02:46,151 INFO [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.67 KB/2735, heapSize ~6 KB/6144, currentSize=0 B/0 for b3181aefe88f68f128e777e32ca5882e in 64ms, sequenceid=6, compaction requested=false 2023-10-01 02:02:46,151 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-01 02:02:46,151 INFO [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/50782faa36789627f8c0ae0ce9f1a845/cf/7fdb378f193c49b7ad54052b481accd9, entries=9, sequenceid=6, filesize=6.5 K 2023-10-01 02:02:46,151 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b3181aefe88f68f128e777e32ca5882e: 2023-10-01 02:02:46,151 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,151 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 02:02:46,151 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3181aefe88f68f128e777e32ca5882e/cf/af260c2f13b34c59a121ea18d6c5b821] hfiles 2023-10-01 02:02:46,151 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3181aefe88f68f128e777e32ca5882e/cf/af260c2f13b34c59a121ea18d6c5b821 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,152 INFO [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~601 B/601, heapSize ~1.50 KB/1536, currentSize=0 B/0 for 50782faa36789627f8c0ae0ce9f1a845 in 65ms, sequenceid=6, compaction requested=false 2023-10-01 02:02:46,154 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 50782faa36789627f8c0ae0ce9f1a845: 2023-10-01 02:02:46,154 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,154 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 02:02:46,154 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/50782faa36789627f8c0ae0ce9f1a845/cf/7fdb378f193c49b7ad54052b481accd9] hfiles 2023-10-01 02:02:46,154 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/50782faa36789627f8c0ae0ce9f1a845/cf/7fdb378f193c49b7ad54052b481accd9 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,164 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e. completed. 2023-10-01 02:02:46,165 DEBUG [rs(jenkins-hbase17.apache.org,45065,1696125669145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e. 2023-10-01 02:02:46,165 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 02:02:46,165 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 02:02:46,165 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:46,165 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845. completed. 2023-10-01 02:02:46,165 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 02:02:46,165 DEBUG [rs(jenkins-hbase17.apache.org,43503,1696125669195)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845. 2023-10-01 02:02:46,165 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,45065,1696125669145' in zk 2023-10-01 02:02:46,165 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 02:02:46,165 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 02:02:46,165 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:46,165 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 02:02:46,165 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,43503,1696125669195' in zk 2023-10-01 02:02:46,166 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:46,166 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 02:02:46,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:46,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:46,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:46,166 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:46,166 DEBUG [member: 'jenkins-hbase17.apache.org,45065,1696125669145' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 02:02:46,168 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:46,169 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 02:02:46,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:46,169 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:46,169 DEBUG [member: 'jenkins-hbase17.apache.org,43503,1696125669195' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 02:02:46,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:46,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:46,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:46,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:46,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:46,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:46,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:46,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:46,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,45065,1696125669145': 2023-10-01 02:02:46,172 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,45065,1696125669145' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-01 02:02:46,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:46,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:46,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:46,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:46,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:46,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:46,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:46,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:46,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,43503,1696125669195': 2023-10-01 02:02:46,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,43503,1696125669195' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-01 02:02:46,175 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-01 02:02:46,175 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 02:02:46,175 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 02:02:46,175 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,175 INFO [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 02:02:46,176 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,176 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,176 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,176 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,176 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:46,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 02:02:46,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 02:02:46,176 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:46,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,176 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:46,176 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:46,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 02:02:46,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:46,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:46,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:46,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:46,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:46,177 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:46,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:46,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,177 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:46,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 02:02:46,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:46,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:46,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:46,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 02:02:46,178 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:46,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,179 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:46,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:46,179 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:46,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:46,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:46,181 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:46,181 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:46,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:46,181 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 02:02:46,181 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:46,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:46,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:46,181 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:46,181 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:46,181 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 02:02:46,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:46,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 02:02:46,181 DEBUG [(jenkins-hbase17.apache.org,37789,1696125668050)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 02:02:46,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 02:02:46,181 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,181 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,182 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,183 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:46,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:46,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:46,183 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,183 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:46,183 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 02:02:46,183 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,183 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:02:46,183 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,183 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:46,183 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:46,183 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,183 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:46,184 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20231001fd0457754c7d488298280e80b1b58435, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231001c1c41e53f8e940dd818338ddc4e3b286] mob files 2023-10-01 02:02:46,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 02:02:46,184 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20231001fd0457754c7d488298280e80b1b58435 2023-10-01 02:02:46,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:46,184 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231001c1c41e53f8e940dd818338ddc4e3b286 2023-10-01 02:02:46,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 02:02:46,189 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,190 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,204 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-01 02:02:46,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,205 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696125766047Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696125766189 (+142 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696125766189Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1696125766189Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1696125766192 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696125766198 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696125766204 (+6 ms) 2023-10-01 02:02:46,207 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 02:02:46,209 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 159 msec 2023-10-01 02:02:46,351 DEBUG [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 02:02:46,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-01 02:02:46,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 02:02:46,352 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125766352 2023-10-01 02:02:46,352 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33385, tgtDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125766352, rawTgtDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125766352, srcFsUri=hdfs://localhost:33385, srcDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae 2023-10-01 02:02:46,375 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33385, inputRoot=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae 2023-10-01 02:02:46,376 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1913538309_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125766352, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125766352/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,376 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33385, inputRoot=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae, snapshotDir=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-10-01 02:02:46,389 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125766352/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:46,406 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:46,407 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:46,407 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:46,407 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:47,118 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/hadoop-4713763396105123866.jar 2023-10-01 02:02:47,119 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:47,119 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:47,173 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/hadoop-7633587211087085948.jar 2023-10-01 02:02:47,173 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:47,173 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:47,174 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:47,174 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:47,174 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:47,174 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 02:02:47,175 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 02:02:47,175 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 02:02:47,175 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 02:02:47,176 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 02:02:47,176 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 02:02:47,176 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 02:02:47,177 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 02:02:47,177 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 02:02:47,177 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 02:02:47,177 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 02:02:47,178 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:02:47,178 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:02:47,179 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 02:02:47,179 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:02:47,179 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 02:02:47,179 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 02:02:47,180 DEBUG [Listener at jenkins-hbase17.apache.org/41447] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 02:02:47,492 WARN [Listener at jenkins-hbase17.apache.org/41447] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 02:02:47,494 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-10-01 02:02:47,496 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-10-01 02:02:49,468 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 02:02:49,468 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 02:02:49,470 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0006_000001 (auth:SIMPLE) 2023-10-01 02:02:49,504 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0007_000001 (auth:SIMPLE) 2023-10-01 02:02:50,501 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 02:02:52,948 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0007_000001 (auth:SIMPLE) 2023-10-01 02:02:55,136 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0007_000001 (auth:SIMPLE) 2023-10-01 02:02:57,816 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0007_000001 (auth:SIMPLE) 2023-10-01 02:02:59,665 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 02:02:59,666 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 02:02:59,677 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:59,677 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 02:02:59,678 INFO [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 02:02:59,678 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-403693088_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:59,678 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-01 02:02:59,678 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-01 02:02:59,678 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-403693088_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125766352/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125766352/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:59,679 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125766352/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-01 02:02:59,679 DEBUG [Listener at jenkins-hbase17.apache.org/41447] snapshot.TestExportSnapshot(367): hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/export-test/export-1696125766352/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-01 02:02:59,684 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:59,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:59,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:59,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-01 02:02:59,689 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125779689"}]},"ts":"1696125779689"} 2023-10-01 02:02:59,690 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-10-01 02:02:59,691 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-10-01 02:02:59,692 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=50782faa36789627f8c0ae0ce9f1a845, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b3181aefe88f68f128e777e32ca5882e, UNASSIGN}] 2023-10-01 02:02:59,694 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=50782faa36789627f8c0ae0ce9f1a845, UNASSIGN 2023-10-01 02:02:59,694 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b3181aefe88f68f128e777e32ca5882e, UNASSIGN 2023-10-01 02:02:59,695 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=50782faa36789627f8c0ae0ce9f1a845, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:02:59,695 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=b3181aefe88f68f128e777e32ca5882e, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:02:59,695 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696125779695"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125779695"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125779695"}]},"ts":"1696125779695"} 2023-10-01 02:02:59,695 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696125779695"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696125779695"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696125779695"}]},"ts":"1696125779695"} 2023-10-01 02:02:59,697 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 50782faa36789627f8c0ae0ce9f1a845, server=jenkins-hbase17.apache.org,43503,1696125669195}] 2023-10-01 02:02:59,698 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure b3181aefe88f68f128e777e32ca5882e, server=jenkins-hbase17.apache.org,45065,1696125669145}] 2023-10-01 02:02:59,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-01 02:02:59,849 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 50782faa36789627f8c0ae0ce9f1a845 2023-10-01 02:02:59,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 50782faa36789627f8c0ae0ce9f1a845, disabling compactions & flushes 2023-10-01 02:02:59,849 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845. 2023-10-01 02:02:59,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845. 2023-10-01 02:02:59,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845. after waiting 0 ms 2023-10-01 02:02:59,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845. 2023-10-01 02:02:59,853 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close b3181aefe88f68f128e777e32ca5882e 2023-10-01 02:02:59,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing b3181aefe88f68f128e777e32ca5882e, disabling compactions & flushes 2023-10-01 02:02:59,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e. 2023-10-01 02:02:59,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e. 2023-10-01 02:02:59,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e. after waiting 0 ms 2023-10-01 02:02:59,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e. 2023-10-01 02:02:59,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/50782faa36789627f8c0ae0ce9f1a845/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 02:02:59,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 02:02:59,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3181aefe88f68f128e777e32ca5882e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 02:02:59,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845. 2023-10-01 02:02:59,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 50782faa36789627f8c0ae0ce9f1a845: 2023-10-01 02:02:59,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 02:02:59,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e. 2023-10-01 02:02:59,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for b3181aefe88f68f128e777e32ca5882e: 2023-10-01 02:02:59,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 50782faa36789627f8c0ae0ce9f1a845 2023-10-01 02:02:59,868 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=50782faa36789627f8c0ae0ce9f1a845, regionState=CLOSED 2023-10-01 02:02:59,868 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696125779868"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125779868"}]},"ts":"1696125779868"} 2023-10-01 02:02:59,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed b3181aefe88f68f128e777e32ca5882e 2023-10-01 02:02:59,869 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=b3181aefe88f68f128e777e32ca5882e, regionState=CLOSED 2023-10-01 02:02:59,869 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696125779869"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696125779869"}]},"ts":"1696125779869"} 2023-10-01 02:02:59,874 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-10-01 02:02:59,874 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 50782faa36789627f8c0ae0ce9f1a845, server=jenkins-hbase17.apache.org,43503,1696125669195 in 173 msec 2023-10-01 02:02:59,874 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-10-01 02:02:59,874 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure b3181aefe88f68f128e777e32ca5882e, server=jenkins-hbase17.apache.org,45065,1696125669145 in 172 msec 2023-10-01 02:02:59,875 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=50782faa36789627f8c0ae0ce9f1a845, UNASSIGN in 182 msec 2023-10-01 02:02:59,876 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-10-01 02:02:59,876 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b3181aefe88f68f128e777e32ca5882e, UNASSIGN in 182 msec 2023-10-01 02:02:59,876 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696125779876"}]},"ts":"1696125779876"} 2023-10-01 02:02:59,877 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-10-01 02:02:59,878 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-10-01 02:02:59,879 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 194 msec 2023-10-01 02:02:59,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-01 02:02:59,990 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-10-01 02:02:59,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:59,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:59,994 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:59,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:59,995 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:59,996 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45065] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:59,997 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:59,997 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:59,997 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:59,997 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:59,998 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-01 02:02:59,998 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:59,998 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3181aefe88f68f128e777e32ca5882e 2023-10-01 02:02:59,998 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:59,998 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-10-01 02:02:59,999 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 02:02:59,999 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:59,998 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-10-01 02:02:59,998 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 02:02:59,998 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/50782faa36789627f8c0ae0ce9f1a845 2023-10-01 02:02:59,999 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-01 02:02:59,999 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-10-01 02:02:59,999 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-01 02:02:59,999 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-01 02:02:59,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-01 02:03:00,000 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3181aefe88f68f128e777e32ca5882e/cf, FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3181aefe88f68f128e777e32ca5882e/recovered.edits] 2023-10-01 02:03:00,000 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/50782faa36789627f8c0ae0ce9f1a845/cf, FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/50782faa36789627f8c0ae0ce9f1a845/recovered.edits] 2023-10-01 02:03:00,004 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3181aefe88f68f128e777e32ca5882e/cf/af260c2f13b34c59a121ea18d6c5b821 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3181aefe88f68f128e777e32ca5882e/cf/af260c2f13b34c59a121ea18d6c5b821 2023-10-01 02:03:00,004 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/50782faa36789627f8c0ae0ce9f1a845/cf/7fdb378f193c49b7ad54052b481accd9 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/50782faa36789627f8c0ae0ce9f1a845/cf/7fdb378f193c49b7ad54052b481accd9 2023-10-01 02:03:00,007 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3181aefe88f68f128e777e32ca5882e/recovered.edits/9.seqid to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3181aefe88f68f128e777e32ca5882e/recovered.edits/9.seqid 2023-10-01 02:03:00,007 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/50782faa36789627f8c0ae0ce9f1a845/recovered.edits/9.seqid to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/50782faa36789627f8c0ae0ce9f1a845/recovered.edits/9.seqid 2023-10-01 02:03:00,007 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b3181aefe88f68f128e777e32ca5882e 2023-10-01 02:03:00,007 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/50782faa36789627f8c0ae0ce9f1a845 2023-10-01 02:03:00,007 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-01 02:03:00,008 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-01 02:03:00,008 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-10-01 02:03:00,011 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20231001fd0457754c7d488298280e80b1b58435 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20231001fd0457754c7d488298280e80b1b58435 2023-10-01 02:03:00,012 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231001c1c41e53f8e940dd818338ddc4e3b286 to hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231001c1c41e53f8e940dd818338ddc4e3b286 2023-10-01 02:03:00,012 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-01 02:03:00,014 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 02:03:00,016 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-10-01 02:03:00,018 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-10-01 02:03:00,019 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 02:03:00,019 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-10-01 02:03:00,019 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696125780019"}]},"ts":"9223372036854775807"} 2023-10-01 02:03:00,019 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696125780019"}]},"ts":"9223372036854775807"} 2023-10-01 02:03:00,022 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 02:03:00,022 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 50782faa36789627f8c0ae0ce9f1a845, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696125765228.50782faa36789627f8c0ae0ce9f1a845.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b3181aefe88f68f128e777e32ca5882e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696125765228.b3181aefe88f68f128e777e32ca5882e.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 02:03:00,022 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-10-01 02:03:00,022 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696125780022"}]},"ts":"9223372036854775807"} 2023-10-01 02:03:00,024 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-10-01 02:03:00,025 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 02:03:00,026 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 34 msec 2023-10-01 02:03:00,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-01 02:03:00,101 INFO [Listener at jenkins-hbase17.apache.org/41447] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-10-01 02:03:00,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-01 02:03:00,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:03:00,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-01 02:03:00,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37789] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 02:03:00,136 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 765), OpenFileDescriptor=919 (was 949), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=247 (was 260), ProcessCount=179 (was 179), AvailableMemoryMB=8371 (was 8338) - AvailableMemoryMB LEAK? - 2023-10-01 02:03:00,136 WARN [Listener at jenkins-hbase17.apache.org/41447] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-01 02:03:00,136 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-10-01 02:03:00,148 INFO [Listener at jenkins-hbase17.apache.org/41447] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-10-01 02:03:03,985 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696125675850_0007_000001 (auth:SIMPLE) 2023-10-01 02:03:05,423 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 02:03:14,275 INFO [Listener at jenkins-hbase17.apache.org/41447] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-10-01 02:03:28,393 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-01 02:03:28,394 INFO [Listener at jenkins-hbase17.apache.org/41447] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-10-01 02:03:28,502 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-10-01 02:03:28,511 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-10-01 02:03:28,512 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-01 02:03:28,525 INFO [Listener at jenkins-hbase17.apache.org/41447] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-10-01 02:03:28,629 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-01 02:03:28,629 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-10-01 02:03:28,629 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-01 02:03:28,629 INFO [Listener at jenkins-hbase17.apache.org/41447] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-01 02:03:28,630 DEBUG [Listener at jenkins-hbase17.apache.org/41447] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3aa0115b to 127.0.0.1:51733 2023-10-01 02:03:28,630 DEBUG [Listener at jenkins-hbase17.apache.org/41447] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:03:28,630 DEBUG [Listener at jenkins-hbase17.apache.org/41447] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-01 02:03:28,630 DEBUG [Listener at jenkins-hbase17.apache.org/41447] util.JVMClusterUtil(257): Found active master hash=1733856222, stopped=false 2023-10-01 02:03:28,630 DEBUG [Listener at jenkins-hbase17.apache.org/41447] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 02:03:28,630 DEBUG [Listener at jenkins-hbase17.apache.org/41447] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-01 02:03:28,630 INFO [Listener at jenkins-hbase17.apache.org/41447] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase17.apache.org,37789,1696125668050 2023-10-01 02:03:28,631 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-01 02:03:28,631 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-01 02:03:28,631 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-01 02:03:28,631 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-01 02:03:28,631 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 02:03:28,631 INFO [Listener at jenkins-hbase17.apache.org/41447] procedure2.ProcedureExecutor(628): Stopping 2023-10-01 02:03:28,632 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 02:03:28,632 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 02:03:28,632 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 02:03:28,632 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 02:03:28,632 DEBUG [Listener at jenkins-hbase17.apache.org/41447] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x591e1af1 to 127.0.0.1:51733 2023-10-01 02:03:28,632 DEBUG [Listener at jenkins-hbase17.apache.org/41447] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:03:28,632 INFO [Listener at jenkins-hbase17.apache.org/41447] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,45065,1696125669145' ***** 2023-10-01 02:03:28,632 DEBUG [Listener at jenkins-hbase17.apache.org/41447] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 02:03:28,632 INFO [Listener at jenkins-hbase17.apache.org/41447] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-01 02:03:28,632 INFO [Listener at jenkins-hbase17.apache.org/41447] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,43503,1696125669195' ***** 2023-10-01 02:03:28,632 INFO [RS:0;jenkins-hbase17:45065] regionserver.HeapMemoryManager(220): Stopping 2023-10-01 02:03:28,633 DEBUG [Listener at jenkins-hbase17.apache.org/41447] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 02:03:28,633 INFO [Listener at jenkins-hbase17.apache.org/41447] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-01 02:03:28,633 INFO [RS:0;jenkins-hbase17:45065] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-01 02:03:28,633 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-01 02:03:28,633 INFO [RS:0;jenkins-hbase17:45065] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-01 02:03:28,633 INFO [Listener at jenkins-hbase17.apache.org/41447] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,44975,1696125669240' ***** 2023-10-01 02:03:28,633 INFO [RS:1;jenkins-hbase17:43503] regionserver.HeapMemoryManager(220): Stopping 2023-10-01 02:03:28,633 DEBUG [Listener at jenkins-hbase17.apache.org/41447] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 02:03:28,633 INFO [RS:0;jenkins-hbase17:45065] regionserver.HRegionServer(3305): Received CLOSE for 6d61171d7943c631da3d431e495162f5 2023-10-01 02:03:28,633 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-01 02:03:28,633 INFO [RS:1;jenkins-hbase17:43503] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-01 02:03:28,633 INFO [Listener at jenkins-hbase17.apache.org/41447] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-01 02:03:28,633 INFO [RS:1;jenkins-hbase17:43503] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-01 02:03:28,633 INFO [RS:2;jenkins-hbase17:44975] regionserver.HeapMemoryManager(220): Stopping 2023-10-01 02:03:28,633 INFO [RS:0;jenkins-hbase17:45065] regionserver.HRegionServer(3305): Received CLOSE for 4927cf3d7f9f309e3c0aa87271a3957b 2023-10-01 02:03:28,633 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-01 02:03:28,633 INFO [RS:0;jenkins-hbase17:45065] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:03:28,633 INFO [RS:1;jenkins-hbase17:43503] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:03:28,634 DEBUG [RS:0;jenkins-hbase17:45065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6cbc9d46 to 127.0.0.1:51733 2023-10-01 02:03:28,634 DEBUG [RS:1;jenkins-hbase17:43503] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c2b27eb to 127.0.0.1:51733 2023-10-01 02:03:28,633 INFO [RS:2;jenkins-hbase17:44975] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-01 02:03:28,634 DEBUG [RS:1;jenkins-hbase17:43503] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:03:28,634 INFO [RS:2;jenkins-hbase17:44975] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-01 02:03:28,634 DEBUG [RS:0;jenkins-hbase17:45065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:03:28,634 INFO [RS:2;jenkins-hbase17:44975] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:03:28,634 DEBUG [RS:2;jenkins-hbase17:44975] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13fdb154 to 127.0.0.1:51733 2023-10-01 02:03:28,634 DEBUG [RS:2;jenkins-hbase17:44975] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:03:28,637 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 6d61171d7943c631da3d431e495162f5, disabling compactions & flushes 2023-10-01 02:03:28,638 INFO [RS:0;jenkins-hbase17:45065] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-10-01 02:03:28,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696125671450.6d61171d7943c631da3d431e495162f5. 2023-10-01 02:03:28,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696125671450.6d61171d7943c631da3d431e495162f5. 2023-10-01 02:03:28,638 INFO [RS:1;jenkins-hbase17:43503] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-01 02:03:28,638 INFO [RS:2;jenkins-hbase17:44975] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,44975,1696125669240; all regions closed. 2023-10-01 02:03:28,638 INFO [RS:1;jenkins-hbase17:43503] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-01 02:03:28,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696125671450.6d61171d7943c631da3d431e495162f5. after waiting 0 ms 2023-10-01 02:03:28,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696125671450.6d61171d7943c631da3d431e495162f5. 2023-10-01 02:03:28,638 DEBUG [RS:0;jenkins-hbase17:45065] regionserver.HRegionServer(1478): Online Regions={6d61171d7943c631da3d431e495162f5=hbase:namespace,,1696125671450.6d61171d7943c631da3d431e495162f5., 4927cf3d7f9f309e3c0aa87271a3957b=hbase:acl,,1696125672195.4927cf3d7f9f309e3c0aa87271a3957b.} 2023-10-01 02:03:28,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 6d61171d7943c631da3d431e495162f5 1/1 column families, dataSize=78 B heapSize=488 B 2023-10-01 02:03:28,638 INFO [RS:1;jenkins-hbase17:43503] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-01 02:03:28,638 INFO [RS:1;jenkins-hbase17:43503] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-01 02:03:28,639 INFO [RS:1;jenkins-hbase17:43503] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-01 02:03:28,639 DEBUG [RS:1;jenkins-hbase17:43503] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-10-01 02:03:28,640 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-01 02:03:28,640 DEBUG [RS:1;jenkins-hbase17:43503] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-01 02:03:28,640 DEBUG [RS:0;jenkins-hbase17:45065] regionserver.HRegionServer(1504): Waiting on 4927cf3d7f9f309e3c0aa87271a3957b, 6d61171d7943c631da3d431e495162f5 2023-10-01 02:03:28,640 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-01 02:03:28,640 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-01 02:03:28,640 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-01 02:03:28,640 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-01 02:03:28,640 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.97 KB heapSize=71.98 KB 2023-10-01 02:03:28,654 DEBUG [RS:2;jenkins-hbase17:44975] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/oldWALs 2023-10-01 02:03:28,654 INFO [RS:2;jenkins-hbase17:44975] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C44975%2C1696125669240:(num 1696125670972) 2023-10-01 02:03:28,654 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-01 02:03:28,654 DEBUG [RS:2;jenkins-hbase17:44975] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:03:28,654 INFO [RS:2;jenkins-hbase17:44975] regionserver.LeaseManager(133): Closed leases 2023-10-01 02:03:28,655 INFO [RS:2;jenkins-hbase17:44975] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-01 02:03:28,655 INFO [RS:2;jenkins-hbase17:44975] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-01 02:03:28,655 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-01 02:03:28,655 INFO [RS:2;jenkins-hbase17:44975] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-01 02:03:28,656 INFO [RS:2;jenkins-hbase17:44975] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-01 02:03:28,657 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-01 02:03:28,657 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-01 02:03:28,658 INFO [RS:2;jenkins-hbase17:44975] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:44975 2023-10-01 02:03:28,660 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/namespace/6d61171d7943c631da3d431e495162f5/.tmp/info/9869294c5d0348d39f54aabd20bfe560 2023-10-01 02:03:28,663 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:03:28,663 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:03:28,663 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 02:03:28,663 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 02:03:28,663 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,44975,1696125669240 2023-10-01 02:03:28,663 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 02:03:28,663 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 02:03:28,664 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,44975,1696125669240] 2023-10-01 02:03:28,670 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,44975,1696125669240; numProcessing=1 2023-10-01 02:03:28,671 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,44975,1696125669240 already deleted, retry=false 2023-10-01 02:03:28,671 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,44975,1696125669240 expired; onlineServers=2 2023-10-01 02:03:28,672 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/1588230740/.tmp/info/77b4ad66134246fe98a23dd44bd51cff 2023-10-01 02:03:28,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/namespace/6d61171d7943c631da3d431e495162f5/.tmp/info/9869294c5d0348d39f54aabd20bfe560 as hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/namespace/6d61171d7943c631da3d431e495162f5/info/9869294c5d0348d39f54aabd20bfe560 2023-10-01 02:03:28,679 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 77b4ad66134246fe98a23dd44bd51cff 2023-10-01 02:03:28,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/namespace/6d61171d7943c631da3d431e495162f5/info/9869294c5d0348d39f54aabd20bfe560, entries=2, sequenceid=6, filesize=4.8 K 2023-10-01 02:03:28,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 6d61171d7943c631da3d431e495162f5 in 42ms, sequenceid=6, compaction requested=false 2023-10-01 02:03:28,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/namespace/6d61171d7943c631da3d431e495162f5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 02:03:28,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 02:03:28,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696125671450.6d61171d7943c631da3d431e495162f5. 2023-10-01 02:03:28,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 6d61171d7943c631da3d431e495162f5: 2023-10-01 02:03:28,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1696125671450.6d61171d7943c631da3d431e495162f5. 2023-10-01 02:03:28,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 4927cf3d7f9f309e3c0aa87271a3957b, disabling compactions & flushes 2023-10-01 02:03:28,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696125672195.4927cf3d7f9f309e3c0aa87271a3957b. 2023-10-01 02:03:28,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696125672195.4927cf3d7f9f309e3c0aa87271a3957b. 2023-10-01 02:03:28,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696125672195.4927cf3d7f9f309e3c0aa87271a3957b. after waiting 0 ms 2023-10-01 02:03:28,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696125672195.4927cf3d7f9f309e3c0aa87271a3957b. 2023-10-01 02:03:28,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 4927cf3d7f9f309e3c0aa87271a3957b 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-10-01 02:03:28,707 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/1588230740/.tmp/rep_barrier/552351c22f3e40619136b6041770180b 2023-10-01 02:03:28,711 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 552351c22f3e40619136b6041770180b 2023-10-01 02:03:28,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/acl/4927cf3d7f9f309e3c0aa87271a3957b/.tmp/l/6596f63ac16e415e98e5fcfcde3f1c55 2023-10-01 02:03:28,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6596f63ac16e415e98e5fcfcde3f1c55 2023-10-01 02:03:28,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/acl/4927cf3d7f9f309e3c0aa87271a3957b/.tmp/l/6596f63ac16e415e98e5fcfcde3f1c55 as hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/acl/4927cf3d7f9f309e3c0aa87271a3957b/l/6596f63ac16e415e98e5fcfcde3f1c55 2023-10-01 02:03:28,730 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6596f63ac16e415e98e5fcfcde3f1c55 2023-10-01 02:03:28,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/acl/4927cf3d7f9f309e3c0aa87271a3957b/l/6596f63ac16e415e98e5fcfcde3f1c55, entries=7, sequenceid=18, filesize=5.2 K 2023-10-01 02:03:28,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 4927cf3d7f9f309e3c0aa87271a3957b in 33ms, sequenceid=18, compaction requested=false 2023-10-01 02:03:28,739 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/1588230740/.tmp/table/4713a40ec8da4e6cb5b43a79952193ff 2023-10-01 02:03:28,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/acl/4927cf3d7f9f309e3c0aa87271a3957b/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-10-01 02:03:28,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 02:03:28,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1696125672195.4927cf3d7f9f309e3c0aa87271a3957b. 2023-10-01 02:03:28,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 4927cf3d7f9f309e3c0aa87271a3957b: 2023-10-01 02:03:28,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1696125672195.4927cf3d7f9f309e3c0aa87271a3957b. 2023-10-01 02:03:28,743 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4713a40ec8da4e6cb5b43a79952193ff 2023-10-01 02:03:28,744 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/1588230740/.tmp/info/77b4ad66134246fe98a23dd44bd51cff as hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/1588230740/info/77b4ad66134246fe98a23dd44bd51cff 2023-10-01 02:03:28,748 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 77b4ad66134246fe98a23dd44bd51cff 2023-10-01 02:03:28,748 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/1588230740/info/77b4ad66134246fe98a23dd44bd51cff, entries=48, sequenceid=131, filesize=10.3 K 2023-10-01 02:03:28,749 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/1588230740/.tmp/rep_barrier/552351c22f3e40619136b6041770180b as hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/1588230740/rep_barrier/552351c22f3e40619136b6041770180b 2023-10-01 02:03:28,753 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 552351c22f3e40619136b6041770180b 2023-10-01 02:03:28,753 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/1588230740/rep_barrier/552351c22f3e40619136b6041770180b, entries=13, sequenceid=131, filesize=6.4 K 2023-10-01 02:03:28,753 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/1588230740/.tmp/table/4713a40ec8da4e6cb5b43a79952193ff as hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/1588230740/table/4713a40ec8da4e6cb5b43a79952193ff 2023-10-01 02:03:28,757 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4713a40ec8da4e6cb5b43a79952193ff 2023-10-01 02:03:28,758 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/1588230740/table/4713a40ec8da4e6cb5b43a79952193ff, entries=24, sequenceid=131, filesize=6.9 K 2023-10-01 02:03:28,758 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.97 KB/47078, heapSize ~71.93 KB/73656, currentSize=0 B/0 for 1588230740 in 118ms, sequenceid=131, compaction requested=false 2023-10-01 02:03:28,766 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 02:03:28,766 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:44975-0x100ffb602650003, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 02:03:28,766 INFO [RS:2;jenkins-hbase17:44975] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,44975,1696125669240; zookeeper connection closed. 2023-10-01 02:03:28,766 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@64ed306f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@64ed306f 2023-10-01 02:03:28,769 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-10-01 02:03:28,769 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 02:03:28,769 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-01 02:03:28,770 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-01 02:03:28,770 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-01 02:03:28,771 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-01 02:03:28,781 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-10-01 02:03:28,781 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-10-01 02:03:28,788 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-10-01 02:03:28,788 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-10-01 02:03:28,840 INFO [RS:1;jenkins-hbase17:43503] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,43503,1696125669195; all regions closed. 2023-10-01 02:03:28,840 INFO [RS:0;jenkins-hbase17:45065] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,45065,1696125669145; all regions closed. 2023-10-01 02:03:28,846 DEBUG [RS:1;jenkins-hbase17:43503] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/oldWALs 2023-10-01 02:03:28,846 DEBUG [RS:0;jenkins-hbase17:45065] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/oldWALs 2023-10-01 02:03:28,846 INFO [RS:1;jenkins-hbase17:43503] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C43503%2C1696125669195.meta:.meta(num 1696125671124) 2023-10-01 02:03:28,846 INFO [RS:0;jenkins-hbase17:45065] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C45065%2C1696125669145:(num 1696125670974) 2023-10-01 02:03:28,846 DEBUG [RS:0;jenkins-hbase17:45065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:03:28,846 INFO [RS:0;jenkins-hbase17:45065] regionserver.LeaseManager(133): Closed leases 2023-10-01 02:03:28,846 INFO [RS:0;jenkins-hbase17:45065] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-01 02:03:28,847 INFO [RS:0;jenkins-hbase17:45065] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-01 02:03:28,847 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-01 02:03:28,847 INFO [RS:0;jenkins-hbase17:45065] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-01 02:03:28,847 INFO [RS:0;jenkins-hbase17:45065] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-01 02:03:28,848 INFO [RS:0;jenkins-hbase17:45065] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:45065 2023-10-01 02:03:28,849 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 02:03:28,850 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:03:28,850 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,45065,1696125669145 2023-10-01 02:03:28,850 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,45065,1696125669145] 2023-10-01 02:03:28,850 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,45065,1696125669145; numProcessing=2 2023-10-01 02:03:28,851 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,45065,1696125669145 already deleted, retry=false 2023-10-01 02:03:28,851 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,45065,1696125669145 expired; onlineServers=1 2023-10-01 02:03:28,852 DEBUG [RS:1;jenkins-hbase17:43503] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/oldWALs 2023-10-01 02:03:28,852 INFO [RS:1;jenkins-hbase17:43503] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C43503%2C1696125669195:(num 1696125670975) 2023-10-01 02:03:28,852 DEBUG [RS:1;jenkins-hbase17:43503] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:03:28,853 INFO [RS:1;jenkins-hbase17:43503] regionserver.LeaseManager(133): Closed leases 2023-10-01 02:03:28,853 INFO [RS:1;jenkins-hbase17:43503] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-01 02:03:28,853 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-01 02:03:28,854 INFO [RS:1;jenkins-hbase17:43503] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:43503 2023-10-01 02:03:28,855 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,43503,1696125669195 2023-10-01 02:03:28,855 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 02:03:28,855 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,43503,1696125669195] 2023-10-01 02:03:28,855 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,43503,1696125669195; numProcessing=3 2023-10-01 02:03:28,856 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,43503,1696125669195 already deleted, retry=false 2023-10-01 02:03:28,856 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,43503,1696125669195 expired; onlineServers=0 2023-10-01 02:03:28,856 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,37789,1696125668050' ***** 2023-10-01 02:03:28,856 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-01 02:03:28,856 DEBUG [M:0;jenkins-hbase17:37789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@266581e5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-10-01 02:03:28,856 INFO [M:0;jenkins-hbase17:37789] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,37789,1696125668050 2023-10-01 02:03:28,856 INFO [M:0;jenkins-hbase17:37789] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,37789,1696125668050; all regions closed. 2023-10-01 02:03:28,856 DEBUG [M:0;jenkins-hbase17:37789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 02:03:28,856 DEBUG [M:0;jenkins-hbase17:37789] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-01 02:03:28,857 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-01 02:03:28,857 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1696125670561] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1696125670561,5,FailOnTimeoutGroup] 2023-10-01 02:03:28,857 DEBUG [M:0;jenkins-hbase17:37789] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-01 02:03:28,857 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1696125670560] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1696125670560,5,FailOnTimeoutGroup] 2023-10-01 02:03:28,857 INFO [M:0;jenkins-hbase17:37789] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-01 02:03:28,857 INFO [M:0;jenkins-hbase17:37789] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-01 02:03:28,857 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-10-01 02:03:28,857 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 02:03:28,857 INFO [M:0;jenkins-hbase17:37789] hbase.ChoreService(369): Chore service for: master/jenkins-hbase17:0 had [] on shutdown 2023-10-01 02:03:28,857 DEBUG [M:0;jenkins-hbase17:37789] master.HMaster(1512): Stopping service threads 2023-10-01 02:03:28,857 INFO [M:0;jenkins-hbase17:37789] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-01 02:03:28,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-01 02:03:28,858 ERROR [M:0;jenkins-hbase17:37789] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-16,5,PEWorkerGroup] 2023-10-01 02:03:28,858 INFO [M:0;jenkins-hbase17:37789] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-01 02:03:28,858 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-01 02:03:28,859 DEBUG [M:0;jenkins-hbase17:37789] zookeeper.ZKUtil(398): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-01 02:03:28,859 WARN [M:0;jenkins-hbase17:37789] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-01 02:03:28,859 INFO [M:0;jenkins-hbase17:37789] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-01 02:03:28,859 INFO [M:0;jenkins-hbase17:37789] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-01 02:03:28,859 DEBUG [M:0;jenkins-hbase17:37789] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-01 02:03:28,859 INFO [M:0;jenkins-hbase17:37789] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 02:03:28,859 DEBUG [M:0;jenkins-hbase17:37789] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 02:03:28,860 DEBUG [M:0;jenkins-hbase17:37789] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-01 02:03:28,860 DEBUG [M:0;jenkins-hbase17:37789] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 02:03:28,860 INFO [M:0;jenkins-hbase17:37789] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=376.26 KB heapSize=452.48 KB 2023-10-01 02:03:28,875 INFO [M:0;jenkins-hbase17:37789] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=376.26 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4356544b6145431e9217d6aa67459a4e 2023-10-01 02:03:28,879 INFO [M:0;jenkins-hbase17:37789] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4356544b6145431e9217d6aa67459a4e 2023-10-01 02:03:28,879 DEBUG [M:0;jenkins-hbase17:37789] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4356544b6145431e9217d6aa67459a4e as hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4356544b6145431e9217d6aa67459a4e 2023-10-01 02:03:28,883 INFO [M:0;jenkins-hbase17:37789] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4356544b6145431e9217d6aa67459a4e 2023-10-01 02:03:28,883 INFO [M:0;jenkins-hbase17:37789] regionserver.HStore(1080): Added hdfs://localhost:33385/user/jenkins/test-data/3cbfbefe-c5ab-af1d-6995-2b802113c1ae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4356544b6145431e9217d6aa67459a4e, entries=119, sequenceid=899, filesize=28.7 K 2023-10-01 02:03:28,889 INFO [M:0;jenkins-hbase17:37789] regionserver.HRegion(2948): Finished flush of dataSize ~376.26 KB/385294, heapSize ~452.46 KB/463320, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 28ms, sequenceid=899, compaction requested=false 2023-10-01 02:03:28,890 INFO [M:0;jenkins-hbase17:37789] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 02:03:28,890 DEBUG [M:0;jenkins-hbase17:37789] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-01 02:03:28,893 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-01 02:03:28,893 INFO [M:0;jenkins-hbase17:37789] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-01 02:03:28,894 INFO [M:0;jenkins-hbase17:37789] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:37789 2023-10-01 02:03:28,895 DEBUG [M:0;jenkins-hbase17:37789] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase17.apache.org,37789,1696125668050 already deleted, retry=false 2023-10-01 02:03:28,951 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 02:03:28,951 INFO [RS:0;jenkins-hbase17:45065] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,45065,1696125669145; zookeeper connection closed. 2023-10-01 02:03:28,951 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:45065-0x100ffb602650001, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 02:03:28,951 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5ae47849] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5ae47849 2023-10-01 02:03:29,051 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 02:03:29,051 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): master:37789-0x100ffb602650000, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 02:03:29,051 INFO [M:0;jenkins-hbase17:37789] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,37789,1696125668050; zookeeper connection closed. 2023-10-01 02:03:29,152 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 02:03:29,152 DEBUG [Listener at localhost/46623-EventThread] zookeeper.ZKWatcher(600): regionserver:43503-0x100ffb602650002, quorum=127.0.0.1:51733, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 02:03:29,152 INFO [RS:1;jenkins-hbase17:43503] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,43503,1696125669195; zookeeper connection closed. 2023-10-01 02:03:29,152 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@76b7d38e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@76b7d38e 2023-10-01 02:03:29,152 INFO [Listener at jenkins-hbase17.apache.org/41447] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-10-01 02:03:29,152 WARN [Listener at jenkins-hbase17.apache.org/41447] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-01 02:03:29,154 INFO [Listener at jenkins-hbase17.apache.org/41447] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-01 02:03:29,258 WARN [BP-1118179633-136.243.18.41-1696125664470 heartbeating to localhost/127.0.0.1:33385] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-01 02:03:29,258 WARN [BP-1118179633-136.243.18.41-1696125664470 heartbeating to localhost/127.0.0.1:33385] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1118179633-136.243.18.41-1696125664470 (Datanode Uuid e4ac19e1-c7b4-4bca-9490-2954115e0c3c) service to localhost/127.0.0.1:33385 2023-10-01 02:03:29,259 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/cluster_33985e5d-e43f-94f3-71d6-02862cb1aecc/dfs/data/data5/current/BP-1118179633-136.243.18.41-1696125664470] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 02:03:29,260 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/cluster_33985e5d-e43f-94f3-71d6-02862cb1aecc/dfs/data/data6/current/BP-1118179633-136.243.18.41-1696125664470] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 02:03:29,261 WARN [Listener at jenkins-hbase17.apache.org/41447] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-01 02:03:29,263 INFO [Listener at jenkins-hbase17.apache.org/41447] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-01 02:03:29,366 WARN [BP-1118179633-136.243.18.41-1696125664470 heartbeating to localhost/127.0.0.1:33385] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-01 02:03:29,366 WARN [BP-1118179633-136.243.18.41-1696125664470 heartbeating to localhost/127.0.0.1:33385] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1118179633-136.243.18.41-1696125664470 (Datanode Uuid d771726b-5b72-4c3e-8dbd-94b8053687f4) service to localhost/127.0.0.1:33385 2023-10-01 02:03:29,366 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/cluster_33985e5d-e43f-94f3-71d6-02862cb1aecc/dfs/data/data3/current/BP-1118179633-136.243.18.41-1696125664470] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 02:03:29,367 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/cluster_33985e5d-e43f-94f3-71d6-02862cb1aecc/dfs/data/data4/current/BP-1118179633-136.243.18.41-1696125664470] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 02:03:29,368 WARN [Listener at jenkins-hbase17.apache.org/41447] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-01 02:03:29,373 INFO [Listener at jenkins-hbase17.apache.org/41447] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-01 02:03:29,475 WARN [BP-1118179633-136.243.18.41-1696125664470 heartbeating to localhost/127.0.0.1:33385] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-01 02:03:29,475 WARN [BP-1118179633-136.243.18.41-1696125664470 heartbeating to localhost/127.0.0.1:33385] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1118179633-136.243.18.41-1696125664470 (Datanode Uuid 2fbdcc11-7aba-457b-8f23-22889c4ac184) service to localhost/127.0.0.1:33385 2023-10-01 02:03:29,476 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/cluster_33985e5d-e43f-94f3-71d6-02862cb1aecc/dfs/data/data1/current/BP-1118179633-136.243.18.41-1696125664470] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 02:03:29,476 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c6df8080-b3ff-3e7d-f2cc-9e8437979117/cluster_33985e5d-e43f-94f3-71d6-02862cb1aecc/dfs/data/data2/current/BP-1118179633-136.243.18.41-1696125664470] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 02:03:29,494 INFO [Listener at jenkins-hbase17.apache.org/41447] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-01 02:03:29,516 INFO [Listener at jenkins-hbase17.apache.org/41447] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-01 02:03:29,610 INFO [Listener at jenkins-hbase17.apache.org/41447] hbase.HBaseTestingUtility(1293): Minicluster is down